-- Logs begin at Wed 2022-07-20 08:34:32 UTC, end at Wed 2022-07-20 09:27:35 UTC. -- Jul 20 08:59:07.057779 dv-cinder-843309-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 08:59:07.066383 dv-cinder-843309-5-smb devstack@keystone.service[80395]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 08:59:07 2022] *** Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: nodename: dv-cinder-843309-5-smb Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: machine: x86_64 Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: clock source: unix Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: pcre jit disabled Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: detected number of CPU cores: 4 Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: current working directory: / Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: detected binary path: /usr/bin/uwsgi-core Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: your processes number limit is 47680 Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: your memory page size is 4096 bytes Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: detected max file descriptor number: 2048 Jul 20 08:59:07.068408 dv-cinder-843309-5-smb devstack@keystone.service[80395]: lock engine: pthread robust mutexes Jul 20 08:59:07.069320 dv-cinder-843309-5-smb devstack@keystone.service[80395]: thunder lock: enabled Jul 20 08:59:07.069320 dv-cinder-843309-5-smb devstack@keystone.service[80395]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 08:59:07.069320 dv-cinder-843309-5-smb devstack@keystone.service[80395]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 08:59:07.114655 dv-cinder-843309-5-smb devstack@keystone.service[80395]: Python main interpreter initialized at 0x55fcf44459c0 Jul 20 08:59:07.114655 dv-cinder-843309-5-smb devstack@keystone.service[80395]: python threads support enabled Jul 20 08:59:07.114655 dv-cinder-843309-5-smb devstack@keystone.service[80395]: your server socket listen backlog is limited to 100 connections Jul 20 08:59:07.114655 dv-cinder-843309-5-smb devstack@keystone.service[80395]: your mercy for graceful operations on workers is 90 seconds Jul 20 08:59:07.115035 dv-cinder-843309-5-smb devstack@keystone.service[80395]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 08:59:07.115107 dv-cinder-843309-5-smb devstack@keystone.service[80395]: *** Operational MODE: preforking *** Jul 20 08:59:07.115390 dv-cinder-843309-5-smb devstack@keystone.service[80395]: *** uWSGI is running in multiple interpreter mode *** Jul 20 08:59:07.115390 dv-cinder-843309-5-smb devstack@keystone.service[80395]: spawned uWSGI master process (pid: 80395) Jul 20 08:59:07.115567 dv-cinder-843309-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 08:59:07.117000 dv-cinder-843309-5-smb devstack@keystone.service[80395]: spawned uWSGI worker 1 (pid: 80404, cores: 1) Jul 20 08:59:07.117000 dv-cinder-843309-5-smb devstack@keystone.service[80395]: spawned uWSGI worker 2 (pid: 80405, cores: 1) Jul 20 08:59:07.117000 dv-cinder-843309-5-smb devstack@keystone.service[80395]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 08:59:12.528398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:59:12.528398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: from cryptography.utils import int_from_bytes Jul 20 08:59:12.529307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:59:12.529307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: from cryptography.utils import int_from_bytes Jul 20 08:59:12.529307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:59:12.529307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: from cryptography.utils import int_from_bytes Jul 20 08:59:12.530090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:59:12.530090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: from cryptography.utils import int_from_bytes Jul 20 08:59:12.577720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 08:59:12.577899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 08:59:12.577990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 08:59:12.578140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] command line args: [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 08:59:12.578285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 08:59:12.578372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 08:59:12.578441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] command line args: [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 08:59:12.578567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ================================================================================ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 08:59:12.578653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 08:59:12.578848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] admin_token = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.578982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ================================================================================ {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 08:59:12.579072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config_dir = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] admin_token = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] config_dir = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config_source = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] debug = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.579975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] config_source = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] debug = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580870 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.580995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_config_append = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_config_append = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_dir = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_dir = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.581956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_file = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.582990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.583958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.584987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.585071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.585305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.585418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.585793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.585892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.585976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] publish_errors = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] publish_errors = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.586934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] standard_threads = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] standard_threads = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.587958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_journal = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] use_journal = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_json = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] use_json = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_stderr = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] use_stderr = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_syslog = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] use_syslog = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.588832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:59:12.589014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589601 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.589997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.590928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.591974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.592931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.593929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.594946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.595944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.596906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.597895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.598952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.599993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.600913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.601907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.602970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.603921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.604852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.605001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.605081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.605284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.605707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.605859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.605944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.606881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.607956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608415 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.608956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.609926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.610855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.611980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.612934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.613869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.external = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.external = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.614985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.password = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.token = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.password = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] auth.token = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.615965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.616893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.617859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.618928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.619915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.620921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.621957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.622910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.623850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.624934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.625999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.626931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.627963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.628920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.629855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630244 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.630942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.631990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.632925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.633876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.634983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.635971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.636894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.637865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.638956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.639923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.640980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.641932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.642889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.643974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.644975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.645957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.646884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] role.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] role.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.647869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.648983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.649962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.650989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.651156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.651309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.651543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.651619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.651777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.651854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.652968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.653927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.654920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.655996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.656955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.657926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.658927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.659854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.connection = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.660870 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.661960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.662926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.663888 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 08:59:12.664729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:59:12.664877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 08:59:12.695792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.695994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.696063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.696123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.696225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.696316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.704844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.705079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.733106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.733300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.733374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.733469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.878388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.879001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.927698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.927871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.929173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.929410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.993995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.994151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.994246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:12.994374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.019977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.020722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.031646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.032009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.044179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.044391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.044548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.044638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.044959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.045985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 08:59:13.062805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.063016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 08:59:13.063341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.063464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.063672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 08:59:13.063764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 08:59:13.063913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 08:59:13.064330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.064766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.065005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.076025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.076279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.076532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.076827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.077064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.077364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.077623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.077893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.084883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.085934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.088781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.089213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.089555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.089681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.089987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.090130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.090243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.090465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.090740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.090868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.090991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.091274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.091401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.091527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.091770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.091893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.092186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.092280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.092439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.092594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.092787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.092924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.119899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.120024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.121512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.121638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.121799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.121931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.127052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.127176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.127324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.127460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.127556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.127679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.134878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.135001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.135202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.135335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.139785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.139912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.140073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.140958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.141118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.141314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.141407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.141528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.141609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.141739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.160035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.160161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.160306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.160431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.165179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.165385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.168802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.168928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.169074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.169224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.174316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.174444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.177906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.178034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.181685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.181810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.181953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.182912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.183049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.183143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.202405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.202679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.202804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.203024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.203133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.203259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.203394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.203545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.211254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.211525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.212941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.213172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.213348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.213439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.216214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.216488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.216758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.216902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.216983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.217092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.217192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.217447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.217575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.217744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.231907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.232157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.232636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.232801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.233084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.233342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.233441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.233570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.233700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.233781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.233900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.234184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.234469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.234739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.253180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.254157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.256454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.257446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.259759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.260714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.261368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.262480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.262977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.263248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.263576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.264715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.264715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.264996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.271256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.272750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.272877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.274502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.276033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.276316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.276845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.276845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.278578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.278861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.279170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.279413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.287103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.287387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.287661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.288947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.289256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.289528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.295576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.295822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.296119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.296363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.296602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.296898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.297167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.297403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.297596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 08:59:13.297731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.297916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298042 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.298945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.299073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.299202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.299345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.299345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.299633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.299914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.300185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.300439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.300695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.300923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 08:59:13.337110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fcf44459c0 pid: 80404 (default app) Jul 20 08:59:13.338727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fcf44459c0 pid: 80405 (default app) Jul 20 08:59:13.340535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc971-b888-4b05-8c6f-95f29bc9770d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:13.340821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc971-b888-4b05-8c6f-95f29bc9770d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:13.341097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc971-b888-4b05-8c6f-95f29bc9770d None None] PATH_INFO: `/v3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:13.345391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Wed Jul 20 08:59:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:21.044839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:21.045471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:21.045471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:21.052682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:21.060830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:21.061321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:21.061414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:21.130365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: INFO dbcounter [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] Registered counter for database keystone Jul 20 08:59:21.157207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG oslo_db.sqlalchemy.engines [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:59:21.168997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writer thread running {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:59:21.350740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG passlib.handlers.bcrypt [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80404) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 08:59:21.351152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG passlib.handlers.bcrypt [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80404) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 08:59:21.409981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:21.411595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:21.542970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 08:59:21.772914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:21.843387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: INFO dbcounter [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] Registered counter for database keystone Jul 20 08:59:21.865797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG oslo_db.sqlalchemy.engines [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:59:21.873952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writer thread running {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:59:22.006319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebcc65-3539-454c-9afc-6cd37938db24 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:22.012134 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:22.012806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:22.013087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:22.013388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:22.023198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:22.075522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING keystone.common.rbac_enforcer.enforcer [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 08:59:22.076141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73400f82-6236-4e79-b0ab-8cafee4e3a3e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:22.086700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Jul 20 08:59:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 08:59:22.096524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:22.112454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf2f2f-0409-48a4-ab3d-fcb8016e30f4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:22.119069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:22.120233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:22.120512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:22.120781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] PATH_INFO: `/v3/projects/41dd52d259a841e396b3c70a528da3dc` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:22.122532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] RBAC: Authorizing `identity:get_project(project_id=41dd52d259a841e396b3c70a528da3dc)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:22.176911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING keystone.common.rbac_enforcer.enforcer [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 08:59:22.177254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2bf4c-643a-4b20-9171-edaf31803d13 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:22.182085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Wed Jul 20 08:59:22 2022] GET /identity/v3/projects/41dd52d259a841e396b3c70a528da3dc => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:24.203412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54ea6-fb03-42d5-bdd0-60e5bf4a0c47 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:24.204061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54ea6-fb03-42d5-bdd0-60e5bf4a0c47 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:24.204061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54ea6-fb03-42d5-bdd0-60e5bf4a0c47 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:24.208121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 08:59:24.214843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:24.215298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:24.215389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:24.239058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:24.240689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:24.250964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 08:59:24.284624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54ea6-fb03-42d5-bdd0-60e5bf4a0c47 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:24.305490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54ea6-fb03-42d5-bdd0-60e5bf4a0c47 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:24.313605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6868e-b246-44db-b300-2349f1115ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:24.314257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6868e-b246-44db-b300-2349f1115ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:24.314534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6868e-b246-44db-b300-2349f1115ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:24.314805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6868e-b246-44db-b300-2349f1115ed0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:24.324226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6868e-b246-44db-b300-2349f1115ed0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:24.326066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6868e-b246-44db-b300-2349f1115ed0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:24.336002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Jul 20 08:59:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 08:59:24.342708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:24.358085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b11987-4673-4e04-985c-bdcd2b9acd6b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:24.363872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340440-2cea-425c-9a29-c0ae8f56bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:24.364753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340440-2cea-425c-9a29-c0ae8f56bd5b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:24.365027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340440-2cea-425c-9a29-c0ae8f56bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:24.365301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340440-2cea-425c-9a29-c0ae8f56bd5b admin admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:24.366865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340440-2cea-425c-9a29-c0ae8f56bd5b admin admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:24.368711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340440-2cea-425c-9a29-c0ae8f56bd5b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:24.370322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Wed Jul 20 08:59:24 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:26.476147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d60ae5-ae30-4693-b9ab-0c03b1bde72b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:26.476715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d60ae5-ae30-4693-b9ab-0c03b1bde72b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:26.476715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d60ae5-ae30-4693-b9ab-0c03b1bde72b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:26.478921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:26.482396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af005-b33e-407b-a645-8d1cedb4dd01 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:26.482842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af005-b33e-407b-a645-8d1cedb4dd01 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:26.483144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af005-b33e-407b-a645-8d1cedb4dd01 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:26.485687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:26.486006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:26.486163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:26.486464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:26.494187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:26.494570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:26.494970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:26.514017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:26.515206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:26.531859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG passlib.handlers.bcrypt [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80405) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 08:59:26.532283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG passlib.handlers.bcrypt [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80405) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 08:59:26.577402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:26.579155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:26.598462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 7/12] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:26.621253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:26.647764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:26.681145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 6/13] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:26.704885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:26.732789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e5bf-3ee6-478b-a0e9-ff7eedde7856 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:26.766640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:26.767290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:26.767571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:26.767844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:26.805529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f6160-67e0-4fc3-a5ca-8827e4686252 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:26.807808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:26.836677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:26.838147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:26.843526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd39645-865c-461e-8688-214de649364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:26.844623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd39645-865c-461e-8688-214de649364b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:26.844901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd39645-865c-461e-8688-214de649364b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:26.845167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd39645-865c-461e-8688-214de649364b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:26.860011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd39645-865c-461e-8688-214de649364b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:26.864849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-dbd39645-865c-461e-8688-214de649364b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:26.871715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:26.873092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:26.874073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 08:59:26.881330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd39645-865c-461e-8688-214de649364b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:26.947082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 8/15] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 08:59:26.953030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:26.982515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd39645-865c-461e-8688-214de649364b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:27.018050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:27.018724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:27.018997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:27.019269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:27.020016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:27.020313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:27.021883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:27.034151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 8/16] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:27.039797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:27.053905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ad32-c932-4486-a969-f7b6ed51b25f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:27.068188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:27.078648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:27.090895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:27.091635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:27.091912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:27.092181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:27.102255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:27.103731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 08:59:27.124823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:27.125721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:27.126677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 08:59:27.126677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 08:59:27.126677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 08:59:27.126677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:27.126677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 08:59:27.132016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:27.139625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24bdd9-01cd-49c5-88f9-8769d901c2ca None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:27.173555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:27.174444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:27.174718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:27.174992 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:27.176668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:27.178234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:27.180964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:27 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:27.186385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:27.241538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707eb7f-f773-4f79-9812-a3d24ba6f53c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:27.275793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:27.276459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:27.276737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:27.277011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:27.277771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:27.278079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:27.279487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:27.285156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:27.293573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27811b-1774-4d17-924f-4a5612c91493 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:27.297921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 08:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:27.336514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659b7aa-2a60-4707-97b6-a3bc72e7f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:27.337387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659b7aa-2a60-4707-97b6-a3bc72e7f38a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:27.337668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659b7aa-2a60-4707-97b6-a3bc72e7f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:27.337928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659b7aa-2a60-4707-97b6-a3bc72e7f38a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:27.339185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659b7aa-2a60-4707-97b6-a3bc72e7f38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:27.340669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659b7aa-2a60-4707-97b6-a3bc72e7f38a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:27.342425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:27.349027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:27.389111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:27.460257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75627f-c05a-4a63-87b1-a2e2c69585b1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:27.495468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:27.496113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:27.496402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:27.496672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:27.497610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.domain.id=default, user.id=dd5ea26c982443d3be385f2d15148248) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:27.497916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:27.499393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b527e2-be11-430b-b524-ca382800a02f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:27.506349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Jul 20 08:59:27 2022] GET /identity/v3/role_assignments?user.id=dd5ea26c982443d3be385f2d15148248&scope.domain.id=default&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:29.781373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613130b-8dc8-40eb-b66b-f7913e59d1fb None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:29.781995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613130b-8dc8-40eb-b66b-f7913e59d1fb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:29.781995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613130b-8dc8-40eb-b66b-f7913e59d1fb None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:29.783346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:29.794668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:29.795142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:29.795213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:29.818493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:29.819707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:29.845816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d1a99-733a-449d-95b2-4b19cd26d0cb None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:29.846127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d1a99-733a-449d-95b2-4b19cd26d0cb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:29.846366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d1a99-733a-449d-95b2-4b19cd26d0cb None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:29.847752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 12/23] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 08:59:29.853372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:29.853934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:29.854413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:29.890300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:29.892382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:29.935180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 12/24] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:29.975059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:30.022609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 13/25] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 08:59:30.022809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:30.058695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:30.174884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33e5c1-0838-46d3-a3ba-49e92df86a1e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:30.237656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:30.252902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:30.254211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.255335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.255989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.262470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04c351-91a4-4cdf-9457-9fafd6a4a958 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:30.280240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:30.282152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b7f2b77f-a342-4599-add6-2a10571a7832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 08:59:30.310016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:30.310817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:30.311574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 08:59:30.311574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 08:59:30.311574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 08:59:30.311574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:30.311574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 13/26] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 08:59:30.318930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c59f8-71ac-4382-9c10-9535c88c8ab3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.318930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c59f8-71ac-4382-9c10-9535c88c8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.318930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c59f8-71ac-4382-9c10-9535c88c8ab3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.318930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 14/27] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:30.323639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c59f8-71ac-4382-9c10-9535c88c8ab3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:30.330757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704cf20-01de-4153-a7a0-3b50fd3b6546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:30.331447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704cf20-01de-4153-a7a0-3b50fd3b6546 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.331724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704cf20-01de-4153-a7a0-3b50fd3b6546 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.332002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704cf20-01de-4153-a7a0-3b50fd3b6546 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.332757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704cf20-01de-4153-a7a0-3b50fd3b6546 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:30.334176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704cf20-01de-4153-a7a0-3b50fd3b6546 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:30.412517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:30.435388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c59f8-71ac-4382-9c10-9535c88c8ab3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:30.470134 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 14/28] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 20 08:59:30 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:30.471751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb81ac-6d77-43ef-9003-4230bf9c7840 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.472040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb81ac-6d77-43ef-9003-4230bf9c7840 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.472316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb81ac-6d77-43ef-9003-4230bf9c7840 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.473639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 15/29] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:30.474809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.475091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.475365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.477344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:30.478044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.478328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.478610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.479367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:30.479675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:30.481488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2944d-2ee4-4417-a489-f64d2a22314a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:30.496019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 15/30] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 08:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:30.497201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:30.498763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:30.500726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.501355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.501824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.519835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:30.521490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:30.594042 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 16/31] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 08:59:30.595556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:30.608576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 16/32] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:30.627456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:30.701028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:30.743635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:30.746880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0433-bef6-4486-9482-7d3425552d9c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:30.767264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13708555-92d9-46e2-9ae6-10bb88cddac9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:30.802074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71295df4-4d11-453b-9da7-6b5e719fd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:30.802777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71295df4-4d11-453b-9da7-6b5e719fd957 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.805270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71295df4-4d11-453b-9da7-6b5e719fd957 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.805270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71295df4-4d11-453b-9da7-6b5e719fd957 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.805270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71295df4-4d11-453b-9da7-6b5e719fd957 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:30.805823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71295df4-4d11-453b-9da7-6b5e719fd957 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:30.809872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:30.810779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.811059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.811381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.823994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:30.832904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:30.833831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:30.834648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:30.835222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 17/33] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 08:59:30.836056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:30.946957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a4a68-635c-42a5-8273-b3814f316e2d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:30.987735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:30.988436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:30.988718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:30.988994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:30.989805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:30.991409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.010426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 18/34] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 20 08:59:30 2022] POST /identity/v3/roles => generated 225 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:31.011379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.014732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:31.086898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 17/35] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 08:59:30 2022] POST /identity/v3/projects => generated 301 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:31.148250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100d38-7249-455e-b168-c4b209574ae3 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.182367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a4f8-7986-43db-866e-7244a410fb03 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.182713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a4f8-7986-43db-866e-7244a410fb03 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.182929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a4f8-7986-43db-866e-7244a410fb03 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.184582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 18/36] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 08:59:31.189964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.190764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.191051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.191328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.192197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:31.192512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.194076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.204086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.204371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.204533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.204668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 19/37] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:31.210741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.246092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:31.247806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:31.299353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:31.327690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be1c0-802d-4edf-9b76-150463e00ba4 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.351979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 19/38] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:31.368258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.369186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.369516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.369793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.371015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.372485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.374378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 20/39] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:31 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:31.380140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.380285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.446719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:31.490511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757496-a95d-4a6e-a099-a8a944b156b2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.493676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad770f-a8af-4ca1-b7f4-6a238125890a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.519796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:31.525344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e7901-dc4c-4926-a1c2-7e780866087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.526162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e7901-dc4c-4926-a1c2-7e780866087b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.526445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e7901-dc4c-4926-a1c2-7e780866087b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.526720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e7901-dc4c-4926-a1c2-7e780866087b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.527492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.527910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e7901-dc4c-4926-a1c2-7e780866087b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.528297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.528580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.528855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.529398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e7901-dc4c-4926-a1c2-7e780866087b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.530072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.535718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 21/40] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:31.535889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.535973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d9270-40db-44ed-866a-11cabc29c134 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.535973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d9270-40db-44ed-866a-11cabc29c134 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.535973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d9270-40db-44ed-866a-11cabc29c134 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.536140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 20/41] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:31.536211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 22/42] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:31.538118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.538881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d9270-40db-44ed-866a-11cabc29c134 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.643424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d58cd3-1cd0-40c4-b4c7-b03a49eb416a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.644486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d9270-40db-44ed-866a-11cabc29c134 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.664995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:31.679001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd80f-920f-4cea-a07d-21928f784916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.679268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.679904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd80f-920f-4cea-a07d-21928f784916 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.679991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.680182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd80f-920f-4cea-a07d-21928f784916 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.680267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.680457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd80f-920f-4cea-a07d-21928f784916 None admin] PATH_INFO: `/v3/domains/default/users/dd5ea26c982443d3be385f2d15148248/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.680541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.681191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.682498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd80f-920f-4cea-a07d-21928f784916 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dd5ea26c982443d3be385f2d15148248, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.682684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.683945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd80f-920f-4cea-a07d-21928f784916 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:31.703635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 23/43] 10.222.0.67 () {58 vars in 1361 bytes} [Wed Jul 20 08:59:31 2022] PUT /identity/v3/domains/default/users/dd5ea26c982443d3be385f2d15148248/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 08:59:31.705186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b747e0-8de2-4cdd-be1e-8f68cdf5de92 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.705569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b747e0-8de2-4cdd-be1e-8f68cdf5de92 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.705850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b747e0-8de2-4cdd-be1e-8f68cdf5de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.723278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 21/44] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 08:59:31 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:31.724588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b3b747e0-8de2-4cdd-be1e-8f68cdf5de92 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:31.725880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b3b747e0-8de2-4cdd-be1e-8f68cdf5de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:31.803105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:31.825288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 24/45] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:31.845094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:31.960799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbda650-b087-41ee-9477-19d484d3bbd0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:31.995952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d11c9-a2b1-4ee4-bd01-0f091eeb9e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:31.996633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d11c9-a2b1-4ee4-bd01-0f091eeb9e08 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:31.996892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d11c9-a2b1-4ee4-bd01-0f091eeb9e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:31.997181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d11c9-a2b1-4ee4-bd01-0f091eeb9e08 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:31.997965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d11c9-a2b1-4ee4-bd01-0f091eeb9e08 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:31.999388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d11c9-a2b1-4ee4-bd01-0f091eeb9e08 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:32.017300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 22/46] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 20 08:59:31 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:33.768597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d1db-1f53-451c-b873-adae71ed7259 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:33.769125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d1db-1f53-451c-b873-adae71ed7259 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:33.769269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d1db-1f53-451c-b873-adae71ed7259 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:33.770818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 25/47] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:33.776407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:33.776845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:33.776929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:33.795486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:33.796879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:33.797166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca11a2-5388-43af-b4b4-3cf284dc3a1e None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:33.797510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca11a2-5388-43af-b4b4-3cf284dc3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:33.797841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca11a2-5388-43af-b4b4-3cf284dc3a1e None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:33.799243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 26/48] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:33.804544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:33.804828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:33.805102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:33.823353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:33.824561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:33.828868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:33.873496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 23/49] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:33.893803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 27/50] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 08:59:33.896907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:33.916999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:33.996890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b62d3-db7b-4fd6-aa17-ac49c434ff55 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.019416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c82e9-1278-4574-8331-c6e364c0c41d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.031639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.032477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.032750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.033025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.040269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:34.044682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:34.053678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:34.054531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:34.055256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 24/51] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:34.056019 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.056774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.057056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.057365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.058590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:34.060222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:34.061019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:34.061906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 28/52] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:34.067504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:34.086823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:34.163767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef6154-b90f-46ac-a562-01746852c6b9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.170115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62521566-d4b2-40fd-a976-a3265243ef5b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.197949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.198657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.198946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.199219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.199983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:34.200291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:34.201740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:34.203778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.204455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.204735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.205014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.205778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:34.207222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:34.214608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 25/53] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:34.220557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:34.317720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:34.334965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec9b8b-b7f6-4200-aef1-ff01c6924a53 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.354106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 29/54] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Jul 20 08:59:34 2022] POST /identity/v3/projects => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:34.373880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.374873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.375498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.375783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.377177 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:34.378807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:34.380681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 26/55] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:34 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:34.386928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:34.435148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:34.500019 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b6a3a-2b9b-4693-befd-4da087966051 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.538385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acd11a-d68f-43df-a9e1-eb57b042562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.539192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acd11a-d68f-43df-a9e1-eb57b042562c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.539483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acd11a-d68f-43df-a9e1-eb57b042562c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.539736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acd11a-d68f-43df-a9e1-eb57b042562c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.540910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acd11a-d68f-43df-a9e1-eb57b042562c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:34.542477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acd11a-d68f-43df-a9e1-eb57b042562c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:34.544309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 30/56] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:34.550429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:34.652697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27ad06-9dc4-480f-a598-d04ee7bd1349 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:34.688475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:34.689163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:34.689483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:34.689770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:34.690623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.domain.id=default, user.id=dd5ea26c982443d3be385f2d15148248) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:34.690952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:34.692424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb52f-3369-4fcb-9081-10b1872169ae None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:34.698716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 27/57] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Jul 20 08:59:34 2022] GET /identity/v3/role_assignments?user.id=dd5ea26c982443d3be385f2d15148248&scope.domain.id=default&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:36.429286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526695-0530-4696-8c9f-b08bf762c1d5 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:36.429802 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526695-0530-4696-8c9f-b08bf762c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:36.429918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526695-0530-4696-8c9f-b08bf762c1d5 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:36.432013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 31/58] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:36.440894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:36.441313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:36.441529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:36.464168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:36.465437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:36.479428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:36.554086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 28/59] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:36.580578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526695-0530-4696-8c9f-b08bf762c1d5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:36.689972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526695-0530-4696-8c9f-b08bf762c1d5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:36.699132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:36.726984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2af74-c3ea-4d43-9431-8d617f96d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:36.727778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2af74-c3ea-4d43-9431-8d617f96d818 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:36.728050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2af74-c3ea-4d43-9431-8d617f96d818 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:36.728314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2af74-c3ea-4d43-9431-8d617f96d818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:36.729554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2af74-c3ea-4d43-9431-8d617f96d818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:36.731392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2af74-c3ea-4d43-9431-8d617f96d818 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:36.733020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 32/60] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:36.739099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:36.839318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f04e22-0182-4b03-8587-0f1947351116 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:36.876370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab048a3-ffa5-49ac-bd06-41352e50e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:36.877047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab048a3-ffa5-49ac-bd06-41352e50e736 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:36.877362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab048a3-ffa5-49ac-bd06-41352e50e736 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:36.877648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab048a3-ffa5-49ac-bd06-41352e50e736 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:36.878348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab048a3-ffa5-49ac-bd06-41352e50e736 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:36.879836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab048a3-ffa5-49ac-bd06-41352e50e736 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:36.910106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 29/61] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 08:59:36 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:40.203419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b027926-1994-4115-aaa9-71ab6ed30887 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.204024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b027926-1994-4115-aaa9-71ab6ed30887 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.204024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b027926-1994-4115-aaa9-71ab6ed30887 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.205675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 33/62] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:40.223138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a250-ca3d-4095-ab7d-7cf8bc9ae047 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.223659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a250-ca3d-4095-ab7d-7cf8bc9ae047 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.223659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a250-ca3d-4095-ab7d-7cf8bc9ae047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.228960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:40.245757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7ea0a250-ca3d-4095-ab7d-7cf8bc9ae047 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:40.247632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ea0a250-ca3d-4095-ab7d-7cf8bc9ae047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:40.249696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9b3c-9de5-48a1-8d38-f3409a92cbd8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.250092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9b3c-9de5-48a1-8d38-f3409a92cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.250628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9b3c-9de5-48a1-8d38-f3409a92cbd8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.252204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 34/63] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 08:59:40.257353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.257867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.258351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.289322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:40.291377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:40.337926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 30/64] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:40.339612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe55d9a-1040-4e22-864e-2f98e2ffa4bb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.340134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe55d9a-1040-4e22-864e-2f98e2ffa4bb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.340636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe55d9a-1040-4e22-864e-2f98e2ffa4bb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.342374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 31/65] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:40.348136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.348667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.349152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.376235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:40.377808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:40.394674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 35/66] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:40.395676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:40.469749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 32/67] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 08:59:40.471128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:40.543909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1524f6-5d00-4841-8e5b-1b4eba24a19c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:40.547707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:40.552989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:40.583020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:40.584235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.584806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.585293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.591640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaafd52-039d-408b-b1ba-fbeae69ceedf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:40.597039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:40.606005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:40.606848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:40.607584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:40.610568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 36/68] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:40.611819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:40.633011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4d85e-1909-4986-8768-8011c493b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:40.633867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d85e-1909-4986-8768-8011c493b796 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.634144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d85e-1909-4986-8768-8011c493b796 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.634412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d85e-1909-4986-8768-8011c493b796 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.644759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4d85e-1909-4986-8768-8011c493b796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2ce4d85e-1909-4986-8768-8011c493b796 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:40.652480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:40.653345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:40.654083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 33/69] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:40.655546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49cb94-658b-4381-b777-41db8349c3f2 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.655546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49cb94-658b-4381-b777-41db8349c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.655546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49cb94-658b-4381-b777-41db8349c3f2 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.657085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 34/70] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:40.659086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49cb94-658b-4381-b777-41db8349c3f2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:40.721897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f2f5-033a-4826-bc01-1e46dbee2c26 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:40.758266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:40.759169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.759451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.759728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.769199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49cb94-658b-4381-b777-41db8349c3f2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:40.770175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:40.778308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:40.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:40.780048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 37/71] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:40.780732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:40.798943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:40.808071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:40.810818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:40.811497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.811857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.812050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.812872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:40.813258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:40.814685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5650c02-b069-4cc3-9d5c-fbaa94e4dcae None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:40.822860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 35/72] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:40.824070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4406e-4f01-4574-85ff-2d86c9765d01 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.824356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4406e-4f01-4574-85ff-2d86c9765d01 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.824628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4406e-4f01-4574-85ff-2d86c9765d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.841713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-25c4406e-4f01-4574-85ff-2d86c9765d01 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:40.842955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-25c4406e-4f01-4574-85ff-2d86c9765d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:40.891216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce700a9-d408-4554-8c83-16d1d002c2d2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:40.917065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 36/73] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:40.918675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c934-c5af-43d4-ae5d-ca6640c6cfa1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.918985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c934-c5af-43d4-ae5d-ca6640c6cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.919233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c934-c5af-43d4-ae5d-ca6640c6cfa1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.920524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 37/74] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:40.921215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c934-c5af-43d4-ae5d-ca6640c6cfa1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:40.930439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:40.931119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:40.931398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:40.931674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:40.932430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:40.932738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:40.934163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:40.942589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 38/75] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:40.943391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.030797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.036811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c934-c5af-43d4-ae5d-ca6640c6cfa1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.043404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68af102-365e-4215-b6fe-5c7528d78e12 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.051029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.072942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.073651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.073935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.074207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.074970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:41.075275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.076501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.076687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180682a0-9a01-4875-bec2-00423a8209a3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.077414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.077692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.077961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.085104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 38/76] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:41.086381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.086666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.086941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.093116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.094700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.096424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 39/77] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:40 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:41.097176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.104824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:41.106434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:41.179023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 39/78] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:41.179880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.214801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b7299-49c3-4e7c-a1dd-bac4e6c355c6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.249203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.250011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.250337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.250737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.261166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:41.269030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:41.269866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:41.270598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 40/79] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:41.271192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.280637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.284368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16420c-4c11-41a2-a578-3a8c0ae2e161 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.296145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.325413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.326318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.326596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.326873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.328083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.329923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.331597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 40/80] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:41.332360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.380357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae88de-5b06-4fc7-a7f2-acea0ad29922 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.414773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.415663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.415926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.416211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.417448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.418917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.420556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 41/81] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:41.421346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.433266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982ddb1-f169-4882-8e3d-2cf76cbab916 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.466597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.467255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.467540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.467820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.499163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.512745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.525245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0186d60-4e99-4c2c-91ec-008f00faf722 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.538452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.539890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.559196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.559995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.560278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.560571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.561787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.563546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.565180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 42/82] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:41.565973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.638734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 41/83] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:41.639585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.668905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9bd2f-f7d1-494a-b226-e486e7adf585 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.702757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.703508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.703899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.704382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.705152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:41.705491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.706884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.715470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 43/84] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:41.716091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:41.716610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.720184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.746549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18035d7-d21f-4f3a-9c9a-68d6161c7356 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.780734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.781432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.781784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.782360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.815900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b03d4-ffaf-4e6e-a811-00cdd2d522f3 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:41.848313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:41.848964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:41.849276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:41.849589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:41.849970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.851459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.917652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:41.919160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:41.922306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.925452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:41.950478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 42/85] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:41.951292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.020567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 44/86] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:42.021455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.056788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589fabe-2110-4a8e-8686-e2d4197f55a0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.090973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.091578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.091856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.092138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.092853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.094460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.115056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 43/87] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 08:59:41 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:42.116066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.121070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158909-54f8-4c73-9cd6-35220fd5628d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.130793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:42.154699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:42.171077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.172147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.172483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.172827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.174265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.175852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.178324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 45/88] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:42.179237 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.249290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fcde7-025c-4693-8f8e-f18118547fa4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.291541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.293325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.293431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e20e-157f-4296-b934-311cde9e3989 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.294193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.294476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.297585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.298735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.301489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 44/89] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:42.301489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.335723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.336636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.336917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.338420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.338420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.339886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.342623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 46/90] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:42.342623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.394938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:42.430705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:42.436118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08884c-cd9e-42e9-9196-61fd63230ab1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.467380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2febd-17cc-4e48-96a9-1216f47bb3dc None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.479388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.481178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.481942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.482440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.484552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.487003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.489007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 45/91] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:42.490812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.504699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.505412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.505692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.505963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.506851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=f9773ed50bea40ed89ae85fd5125064d) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:42.507208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.508658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.520476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 47/92] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/role_assignments?user.id=f9773ed50bea40ed89ae85fd5125064d&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:42.520476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.702088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b3e18-c179-47c1-92e9-b9e1a7f53d28 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.705247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:42.709870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d885934-5e8c-4f8b-8272-42641241dbf5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.744475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.745587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.746069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.746569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.747802 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=dd5ea26c982443d3be385f2d15148248) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:42.748310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.750123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.753319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:42.754012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:42.754717 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:42.754717 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:42.758360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 48/93] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/role_assignments?user.id=dd5ea26c982443d3be385f2d15148248&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:42.759658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:42.797796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:42.836899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:42.838470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:42.948569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6d49-3901-4bf1-a977-12fbd83d0f8a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:42.955812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 46/94] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:42.961051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:43.009359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:43.010135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:43.010423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:43.010692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:43.011654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] RBAC: Adding query filter params (role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=f9773ed50bea40ed89ae85fd5125064d) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:43.011971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:43.013489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:43.020849 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 49/95] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/role_assignments?user.id=f9773ed50bea40ed89ae85fd5125064d&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:43.038465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:43.084801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e96d9-373b-4722-be15-f02235288ff7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:43.126106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9862d-2c3f-48ff-9b7f-ae626946b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:43.127289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9862d-2c3f-48ff-9b7f-ae626946b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:43.127569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9862d-2c3f-48ff-9b7f-ae626946b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:43.127843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9862d-2c3f-48ff-9b7f-ae626946b2b7 None admin] PATH_INFO: `/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:43.129083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9862d-2c3f-48ff-9b7f-ae626946b2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=c75c2c1dd31c40b2a6e819c30ad261e9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:43.130599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9862d-2c3f-48ff-9b7f-ae626946b2b7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:43.132627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 47/96] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:42 2022] GET /identity/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:43.138552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:43.184236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:43.273501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bea11-1276-40b9-a7cc-c91ad75d00de None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:43.316489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:43.317269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:43.317465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:43.317742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:43.318599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=c75c2c1dd31c40b2a6e819c30ad261e9, user.id=f9773ed50bea40ed89ae85fd5125064d) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:43.318910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:43.320402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed2c9-e16c-437b-8e53-c8e5897ac9e8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:43.327331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 50/97] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:43 2022] GET /identity/v3/role_assignments?user.id=f9773ed50bea40ed89ae85fd5125064d&scope.project.id=c75c2c1dd31c40b2a6e819c30ad261e9&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:44.900585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb61ce-5257-4fa5-b1e4-85fcbfdc0d67 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:44.901105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb61ce-5257-4fa5-b1e4-85fcbfdc0d67 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:44.901212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb61ce-5257-4fa5-b1e4-85fcbfdc0d67 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:44.902725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 48/98] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:44.908640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dd63-cf57-4981-a421-ed31b108529c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:44.909101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dd63-cf57-4981-a421-ed31b108529c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:44.909309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dd63-cf57-4981-a421-ed31b108529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:44.934246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8258dd63-cf57-4981-a421-ed31b108529c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:44.935697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8258dd63-cf57-4981-a421-ed31b108529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:45.024819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 51/99] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:45.060531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb61ce-5257-4fa5-b1e4-85fcbfdc0d67 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:45.163930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4155-1f1c-438e-a259-250301b00686 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:45.164441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4155-1f1c-438e-a259-250301b00686 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:45.164865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4155-1f1c-438e-a259-250301b00686 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:45.166494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 52/100] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 08:59:45.171547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:45.171998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:45.172516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:45.199622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:45.202420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:45.207362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb61ce-5257-4fa5-b1e4-85fcbfdc0d67 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:45.247450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:45.249639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:45.250996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:45.251425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:45.251864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:45.253224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:45.254887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:45.256825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 49/101] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:45.266331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:45.285637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:45.360154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 53/102] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:45.417138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:45.514451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889edd13-9c9e-46fb-ac90-7bc4fa92ca3f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:45.606543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:45.607248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:45.607534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:45.607814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:45.608551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:45.610295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:45.636845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35ed41-60f8-4036-8e70-3f9fc2d02443 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:45.667337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 50/103] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 08:59:45 2022] POST /identity/v3/projects => generated 302 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:45.692158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:45.693195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:45.693703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:45.694080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:45.710331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:45.718861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:45.720010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:45.720758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 54/104] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 08:59:45.727066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:45.821026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:45.880336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366c446-e450-40c3-95ec-4b6ce9ec13eb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:45.920941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:45.921759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:45.921968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:45.922371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:45.923331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:45.923641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:45.925074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc1db6-365f-4ef3-ba18-88b81652ab32 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:45.935176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 51/105] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:45.941545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:45.964858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.071598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007390-bfa4-4dc4-b08b-b36b78cfdb68 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:46.107764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:46.108651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.108928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.109197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] PATH_INFO: `/v3/users/416246a7715d4ccaaf63eeedac897d94` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.123209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] RBAC: Authorizing `identity:get_user(user_id=416246a7715d4ccaaf63eeedac897d94)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:46.124761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:46.126909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 55/106] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:45 2022] GET /identity/v3/users/416246a7715d4ccaaf63eeedac897d94 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:46.130941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091353e-0b1a-4201-903d-d4a5aa827700 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.131302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091353e-0b1a-4201-903d-d4a5aa827700 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.131583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091353e-0b1a-4201-903d-d4a5aa827700 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.132965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 52/107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:46.136077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:46.139489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb091ea-d4b6-4fc0-9348-240d312ec481 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.139772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb091ea-d4b6-4fc0-9348-240d312ec481 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.140044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb091ea-d4b6-4fc0-9348-240d312ec481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.168036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dbb091ea-d4b6-4fc0-9348-240d312ec481 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:46.169260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dbb091ea-d4b6-4fc0-9348-240d312ec481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:46.256435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 53/108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 08:59:46.258097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797d2a-220c-4610-baf7-23118a5da2d7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.258522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797d2a-220c-4610-baf7-23118a5da2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.258955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797d2a-220c-4610-baf7-23118a5da2d7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.265252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 54/109] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:46.266899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.267430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.267851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.282446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.294968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:46.296164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:46.331734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd00d-9f94-47bb-b1a2-fe974361d305 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:46.357607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.371255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e57e-d26f-4421-9e53-320e7ac6535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:46.372311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e57e-d26f-4421-9e53-320e7ac6535d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.372764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e57e-d26f-4421-9e53-320e7ac6535d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.373214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e57e-d26f-4421-9e53-320e7ac6535d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.381028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 55/110] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:46.382181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:46.465492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e57e-d26f-4421-9e53-320e7ac6535d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:46.468227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e57e-d26f-4421-9e53-320e7ac6535d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:46.496743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c75e2-a1c6-4f8b-ba1e-236bd778f204 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:46.538784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:46.539621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.539968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.540310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.547676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.553307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:46.561102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:46.561954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:46.562669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 56/111] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:46.564117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:46.589635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 56/112] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:46.590784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a57ff-1269-4f62-866b-baa9e7659a2c None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.591049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a57ff-1269-4f62-866b-baa9e7659a2c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.591347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a57ff-1269-4f62-866b-baa9e7659a2c None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.592605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 57/113] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:46.593843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12efc7-f508-4c14-945a-a641cc4095ef None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.594592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12efc7-f508-4c14-945a-a641cc4095ef None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.595006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12efc7-f508-4c14-945a-a641cc4095ef None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.600451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 58/114] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:46.601252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12efc7-f508-4c14-945a-a641cc4095ef None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:46.608572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.680576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fea39-ef5f-46ba-9cb3-4a3fb7bf5f2a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:46.709686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12efc7-f508-4c14-945a-a641cc4095ef None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:46.717961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:46.718812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.719149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.719532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.731722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:46.740227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:46.741067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:46.741849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 57/115] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:46.742453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:46.752796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:46.753536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.753818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.754095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.754862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:46.755166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:46.757050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f75403-f715-43f3-86e2-ec0f31d0cfb4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:46.769449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 59/116] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:46.774523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3d67-5e79-4e14-ba70-2c726622c081 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.774817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3d67-5e79-4e14-ba70-2c726622c081 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.775094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3d67-5e79-4e14-ba70-2c726622c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.792452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-29dc3d67-5e79-4e14-ba70-2c726622c081 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:46.793555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-29dc3d67-5e79-4e14-ba70-2c726622c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:46.824626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.852099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:46.859201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55bd6-6880-43bb-9716-d459c736757c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:46.866895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 60/117] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:46.870412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.871010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.871478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.889094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:46.890558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:46.895160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:46.896056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:46.896336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:46.896618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:46.897865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:46.899419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:46.901360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 58/118] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:46.901926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:46.959976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 61/119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:46.960831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.024472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64e9c-6c88-4109-94d7-0ccf28b91b3b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.060139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.061275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.061763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.062108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.062339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.063163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:47.063470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.065001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.067307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a8f0d-2657-4d61-8409-2fd5619f006a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.078016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 59/120] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.078016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.107663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.110018 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.110913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.111226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.111462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.112884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.114416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.116326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 62/121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:46 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.121463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.184988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4cc24-1073-4916-9332-d672520f1d50 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.220535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.221382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.221665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.221943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.223720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e8a48-f245-445c-abf2-a3d78a74db3d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.232828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:47.240764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:47.241661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:47.242411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 60/122] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:47.243152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.264535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.265205 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.265515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.265796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.266801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] RBAC: Adding query filter params (role.id=95cd352b9b9144ad9f49a86b75b75ec1, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=416246a7715d4ccaaf63eeedac897d94) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:47.267098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.268565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.281287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 63/123] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/role_assignments?user.id=416246a7715d4ccaaf63eeedac897d94&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=95cd352b9b9144ad9f49a86b75b75ec1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.281287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.317984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.371040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.389455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a3608-f78d-4e7a-bb78-8462d4f7ac0a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.427771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.428596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.428875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.429147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.439088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512832d6-4aa4-4571-8f31-3c57e36f68e5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.442162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:47.452539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:47.453684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:47.454485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 61/124] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:47.455099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.481408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.482302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.482590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.482876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.490356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.492581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.495235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 64/125] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.496086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.585406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b03b8-0f7c-475d-b501-068af44d1c5d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.618349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.624653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4afc-482a-4255-8b9c-7caf07f1d402 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.629338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.630269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.630554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.630833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.632048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.633576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.635445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 62/126] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.636466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.654852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.662769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.663747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.664238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.664720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.665716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:47.666238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.667867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.677588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 65/127] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.678723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.757617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8c66-ce81-473c-a885-8afdb7abc6fc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.795153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aaae2-31d9-4141-86eb-7d3d8b47ae67 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.795571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.796327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.796614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.796942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.798232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:47.798550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.800037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.809375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 63/128] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.810376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.838313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.840052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.840761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.841215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.843259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.845523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:47.848162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 66/129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:47.849710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:47.893709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.907992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:47.934603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311189c9-1180-40ca-b476-e180b8b2df26 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.977508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda72d2d-df91-48f1-9987-cb5c645e704f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:47.981094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:47.982243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:47.982790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:47.983180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/f9773ed50bea40ed89ae85fd5125064d/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:47.985521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee, user_id=f9773ed50bea40ed89ae85fd5125064d, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:47.987223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.009313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 64/130] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 08:59:47 2022] PUT /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/f9773ed50bea40ed89ae85fd5125064d/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 08:59:48.010778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.022227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.023540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.023891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.024262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.026017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.027757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.029697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 67/131] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:47 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:48.034527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.146075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:48.149106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496ec5-12d9-40e3-8e74-8b40c8c7e549 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.154020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13201dd3-1370-47ad-b533-ed65791e6b9b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.191348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.192792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.193401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.193940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.194831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.195661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.195839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.196233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.196569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/f9773ed50bea40ed89ae85fd5125064d/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.198145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.199105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] RBAC: Authorizing `identity:create_grant(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee, user_id=f9773ed50bea40ed89ae85fd5125064d, role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.200342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 65/132] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:48 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:48.200840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.201560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.206316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:48.223542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 68/133] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 08:59:48 2022] PUT /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/f9773ed50bea40ed89ae85fd5125064d/roles/1efc231eee0048ba834a4bd3d88a430c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 08:59:48.224820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.326809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cfaea-8d24-4980-ae7d-4099cac588b4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.361263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85574f-e901-40df-a62d-0b027766fbae None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.368830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.370847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.371351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.371881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] PATH_INFO: `/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.373520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] RBAC: Authorizing `identity:get_project(project_id=c75c2c1dd31c40b2a6e819c30ad261e9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.375442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.378252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 66/134] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:48 2022] GET /identity/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:48.385498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.417746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2d658-fcf0-4d5d-977f-8b70a12abb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.418585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d658-fcf0-4d5d-977f-8b70a12abb41 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.418868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d658-fcf0-4d5d-977f-8b70a12abb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.419261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d658-fcf0-4d5d-977f-8b70a12abb41 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.421005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2d658-fcf0-4d5d-977f-8b70a12abb41 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.422763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2d658-fcf0-4d5d-977f-8b70a12abb41 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.425325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 69/135] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:48 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:48.426838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a90cb-37e7-4c5d-b5ee-ce268a7e7294 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.427129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a90cb-37e7-4c5d-b5ee-ce268a7e7294 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.427406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a90cb-37e7-4c5d-b5ee-ce268a7e7294 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.428939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 70/136] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:48.432762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a90cb-37e7-4c5d-b5ee-ce268a7e7294 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.466456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:48.521964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:48.562131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90445cb-91cf-4618-bac1-5e0047bc9da3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.577948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a90cb-37e7-4c5d-b5ee-ce268a7e7294 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.615599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa167ac-588c-4334-b31e-e7b0859c4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.616930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa167ac-588c-4334-b31e-e7b0859c4003 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.617526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa167ac-588c-4334-b31e-e7b0859c4003 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.618000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa167ac-588c-4334-b31e-e7b0859c4003 None admin] PATH_INFO: `/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9/users/f9773ed50bea40ed89ae85fd5125064d/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.620325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa167ac-588c-4334-b31e-e7b0859c4003 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75c2c1dd31c40b2a6e819c30ad261e9, user_id=f9773ed50bea40ed89ae85fd5125064d, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.622533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa167ac-588c-4334-b31e-e7b0859c4003 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.639299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 67/137] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 08:59:48 2022] PUT /identity/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9/users/f9773ed50bea40ed89ae85fd5125064d/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 08:59:48.641455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.642288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.642956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.643169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.644113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.644397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.644670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/dd5ea26c982443d3be385f2d15148248/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.647092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee, user_id=dd5ea26c982443d3be385f2d15148248, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.648733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.668040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:48.670625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:48.679401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 71/138] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 08:59:48 2022] PUT /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/dd5ea26c982443d3be385f2d15148248/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 08:59:48.763908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 68/139] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:48.791488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:48.893865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:48.918626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c25f-4195-4ff7-a035-1765c7729546 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:48.957835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb2129-6aa1-4e62-a003-38d45184a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:48.959036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb2129-6aa1-4e62-a003-38d45184a202 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:48.959537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb2129-6aa1-4e62-a003-38d45184a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:48.960024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb2129-6aa1-4e62-a003-38d45184a202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:48.961565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb2129-6aa1-4e62-a003-38d45184a202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:48.963260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb2129-6aa1-4e62-a003-38d45184a202 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:48.965312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 72/140] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:48.971870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:49.042708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:49.087231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11152963-deb7-41bb-85e1-7b41918c40bb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:49.124782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbdfae-fa6d-4910-8b2b-cc290bbfd75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:49.126152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbdfae-fa6d-4910-8b2b-cc290bbfd75b None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:49.126893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbdfae-fa6d-4910-8b2b-cc290bbfd75b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:49.127390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbdfae-fa6d-4910-8b2b-cc290bbfd75b None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:49.128327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbdfae-fa6d-4910-8b2b-cc290bbfd75b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:49.130037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbdfae-fa6d-4910-8b2b-cc290bbfd75b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:49.161470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 69/141] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 08:59:48 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:49.970621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ac8a-bff0-4001-b402-284fb2427826 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:49.971166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ac8a-bff0-4001-b402-284fb2427826 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:49.971166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ac8a-bff0-4001-b402-284fb2427826 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:49.972568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 73/142] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:49.978204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:49.978496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:49.978776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:50.005405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:50.006676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:50.093390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 70/143] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:50.132529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670ac8a-bff0-4001-b402-284fb2427826 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:50.270311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670ac8a-bff0-4001-b402-284fb2427826 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:50.311346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:50.312174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:50.312446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:50.312765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:50.334400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:50.342465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:50.343394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:50.344347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 74/144] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:50.350122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:50.416635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:50.493843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c426d2-d33c-4f4f-87ae-f3fb0fd0d1f0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:50.542234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:50.543256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:50.543752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:50.544216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:50.545179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:50.545710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:50.547346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:50.560879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 71/145] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:50.566824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:50.591881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:50.741317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2487ab-3c69-42ef-a595-8649502e9eed None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:50.780711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:50.781835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:50.782213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:50.782485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] PATH_INFO: `/v3/users/416246a7715d4ccaaf63eeedac897d94` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:50.783763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] RBAC: Authorizing `identity:get_user(user_id=416246a7715d4ccaaf63eeedac897d94)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:50.785206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:50.787279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 75/146] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:50 2022] GET /identity/v3/users/416246a7715d4ccaaf63eeedac897d94 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:50.792996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:50.972782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333188b-e1b7-4cc3-bbf0-3de43d416741 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:50.990412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:51.024674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22141c-572c-4132-bbb8-f0383bfce51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:51.025589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22141c-572c-4132-bbb8-f0383bfce51c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:51.025866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22141c-572c-4132-bbb8-f0383bfce51c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:51.026144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22141c-572c-4132-bbb8-f0383bfce51c None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:51.027353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22141c-572c-4132-bbb8-f0383bfce51c None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:51.028821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22141c-572c-4132-bbb8-f0383bfce51c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:51.030579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 72/147] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:50 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:51.042359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:51.185674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:51.202150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1480a7-9801-4ff7-a97d-840d4e1c34a2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:51.278543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9feb4-9339-4633-af3e-954d72e14bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:51.279466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9feb4-9339-4633-af3e-954d72e14bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:51.279744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9feb4-9339-4633-af3e-954d72e14bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:51.280009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9feb4-9339-4633-af3e-954d72e14bf4 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/416246a7715d4ccaaf63eeedac897d94/roles/95cd352b9b9144ad9f49a86b75b75ec1` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:51.286608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9feb4-9339-4633-af3e-954d72e14bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee, user_id=416246a7715d4ccaaf63eeedac897d94, role_id=95cd352b9b9144ad9f49a86b75b75ec1)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:51.288152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9feb4-9339-4633-af3e-954d72e14bf4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:51.311576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 76/148] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 08:59:51 2022] PUT /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/users/416246a7715d4ccaaf63eeedac897d94/roles/95cd352b9b9144ad9f49a86b75b75ec1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 08:59:51.542661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ab10-4a09-41c1-bd82-e6accd89521c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:51.543155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ab10-4a09-41c1-bd82-e6accd89521c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:51.543155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ab10-4a09-41c1-bd82-e6accd89521c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:51.544527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 73/149] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:51.555106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:51.555437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:51.555657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:51.578573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:51.579833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:51.675839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 77/150] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:51.723844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617ab10-4a09-41c1-bd82-e6accd89521c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:51.874320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617ab10-4a09-41c1-bd82-e6accd89521c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:51.921224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a559c4-66ef-42c8-90d3-4520d974da8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:51.922100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a559c4-66ef-42c8-90d3-4520d974da8b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:51.922382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a559c4-66ef-42c8-90d3-4520d974da8b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:51.922648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a559c4-66ef-42c8-90d3-4520d974da8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:51.946882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a559c4-66ef-42c8-90d3-4520d974da8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-68a559c4-66ef-42c8-90d3-4520d974da8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:51.959813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:51.960712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:51.961562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 74/151] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:51.970368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:52.080831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4756-a394-4d30-aeff-19e6a3a0d6d6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.081112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4756-a394-4d30-aeff-19e6a3a0d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.081671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4756-a394-4d30-aeff-19e6a3a0d6d6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.083494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 75/152] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:52.086294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:52.094779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.095380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.095848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.131012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba9e3-0426-47a6-93b2-2ba968e9dc0c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:52.138404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:52.139726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:52.185980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:52.186928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.187339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.187786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.189105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:52.189566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:52.191076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:52.209263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 78/153] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:52.209465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:52.214339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:52.270924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 76/154] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:52.322348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:52.367570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5e8e-d56f-41c5-80a0-a76b92d252f8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:52.401693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:52.417243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14191b-d35c-4bde-8c8e-5c926d262ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:52.418152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14191b-d35c-4bde-8c8e-5c926d262ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.418437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14191b-d35c-4bde-8c8e-5c926d262ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.418715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14191b-d35c-4bde-8c8e-5c926d262ab4 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.420032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14191b-d35c-4bde-8c8e-5c926d262ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:52.421520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14191b-d35c-4bde-8c8e-5c926d262ab4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:52.425108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 79/155] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:52 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:52.426387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6b2e-a999-4d6e-9b69-17b0925c959b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.426666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6b2e-a999-4d6e-9b69-17b0925c959b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.426938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6b2e-a999-4d6e-9b69-17b0925c959b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.428336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 80/156] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:52.434214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256fd23-df84-476b-8ae9-f94396137bbe None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.434536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256fd23-df84-476b-8ae9-f94396137bbe None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.434820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256fd23-df84-476b-8ae9-f94396137bbe None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.440405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 81/157] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:52.441028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256fd23-df84-476b-8ae9-f94396137bbe None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:52.533071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4afc7-7bd4-4495-836b-ee622c8873f9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:52.607625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8fd3e-e876-4a5c-9e90-3af7d5b558ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:52.609286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8fd3e-e876-4a5c-9e90-3af7d5b558ef None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.609819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8fd3e-e876-4a5c-9e90-3af7d5b558ef None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.610538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8fd3e-e876-4a5c-9e90-3af7d5b558ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.634878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8fd3e-e876-4a5c-9e90-3af7d5b558ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-74c8fd3e-e876-4a5c-9e90-3af7d5b558ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:52.647480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:52.648524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:52.649384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 77/158] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:52.650511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4256f-9836-4d39-9f8a-4b34d9a98e1e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.650511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4256f-9836-4d39-9f8a-4b34d9a98e1e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.650652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4256f-9836-4d39-9f8a-4b34d9a98e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.674961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256fd23-df84-476b-8ae9-f94396137bbe None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:52.677896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8cc4256f-9836-4d39-9f8a-4b34d9a98e1e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:52.679179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8cc4256f-9836-4d39-9f8a-4b34d9a98e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:52.723321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:52.762041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:52.762717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.762997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.763271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.804914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 78/159] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:52.806419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:52.806708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:52.806981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:52.834950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:52.836144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:52.924844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:52.942169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:52.943614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:52.948445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 79/160] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:52.949375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.109666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:53.128023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af40-92dc-43e8-aa4b-48166087d921 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:53.147314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 82/161] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:53.148183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.230934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:53.231860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.232278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.232686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.233632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:53.234085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:53.235656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:53.255597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 80/162] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:53.256539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.341595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:53.348290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf9462-7173-48ca-b31c-b6422280b93f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:53.422147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:53.423355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.423832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.424378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.443607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:53.455359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:53.456226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:53.457033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:53.462142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 83/163] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:53.464431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8923e2d-39ab-4624-bcf1-a9e78a1ca94a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:53.467203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.533940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:53.535150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.535627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.536104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.579526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:53.597903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:53.599253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:53.600008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:53.603829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 81/164] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 08:59:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:53.606338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.639180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:53.653572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a4f6-587d-4eac-b3ef-d241ef01d316 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:53.730656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39232fba-646d-4544-b9ab-86fea5bca3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:53.732012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39232fba-646d-4544-b9ab-86fea5bca3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.732510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39232fba-646d-4544-b9ab-86fea5bca3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.734974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39232fba-646d-4544-b9ab-86fea5bca3b8 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.738133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39232fba-646d-4544-b9ab-86fea5bca3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:53.742833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39232fba-646d-4544-b9ab-86fea5bca3b8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:53.747413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 84/165] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:53 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:53.748993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6a49-cde6-45a8-96a8-29d3649c5861 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.751724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6a49-cde6-45a8-96a8-29d3649c5861 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.754805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6a49-cde6-45a8-96a8-29d3649c5861 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.756707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 85/166] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:53.762972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f6a49-cde6-45a8-96a8-29d3649c5861 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.817497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:53.826636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0f9d-d5a8-4b09-9d07-471030cbbd9d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:53.868750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:53.870085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.870364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.870658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] PATH_INFO: `/v3/users/dd5ea26c982443d3be385f2d15148248` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.871909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5ea26c982443d3be385f2d15148248)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:53.873448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:53.880447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 82/167] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:53 2022] GET /identity/v3/users/dd5ea26c982443d3be385f2d15148248 => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:53.880447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:53.932075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f6a49-cde6-45a8-96a8-29d3649c5861 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:53.981875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:53.983484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:53.983801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:53.984200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:53.986318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:53.986905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:53.988027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:53.991407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.005702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 86/168] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:54.007091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.020098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdfc1b-7b45-4bca-aad6-e8a627ac38c8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.070735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.071484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.071827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.072163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.072988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:54.073397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:54.075402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cca1f-482a-4000-bfeb-dc447c4c0a88 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.091375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 83/169] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 08:59:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:54.091375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464763-9173-405d-baa4-fad620989539 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.091375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464763-9173-405d-baa4-fad620989539 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.091375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464763-9173-405d-baa4-fad620989539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.114668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a464763-9173-405d-baa4-fad620989539 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:54.116193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a464763-9173-405d-baa4-fad620989539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:54.150505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:54.173386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f08f28-ca0f-4fc7-a620-87b6a17c3c7c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.208903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 84/170] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:54.210801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057c664-62f3-4b7c-a8b1-6febf869187e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.211240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057c664-62f3-4b7c-a8b1-6febf869187e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.211655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057c664-62f3-4b7c-a8b1-6febf869187e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.212656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.213475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 85/171] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:54.213642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.213928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.214291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.214823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057c664-62f3-4b7c-a8b1-6febf869187e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.215417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=f9773ed50bea40ed89ae85fd5125064d) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:54.215823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:54.217756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.225311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 87/172] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/role_assignments?user.id=f9773ed50bea40ed89ae85fd5125064d&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:54.226103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.351707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:54.418669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3d01-c672-4fa4-b39a-13ebdf486f0f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.436918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057c664-62f3-4b7c-a8b1-6febf869187e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.480747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.481706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.482536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.482536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.484186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:54.485920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.487621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 88/173] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:54.488459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.489381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.490116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.490563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.491037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.529668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:54.576777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:54.578411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.633412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630943-aab6-44a4-98e1-af35b23bcfd1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.662386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:54.673268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124e83d-981d-424d-8936-24741aa21174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.674364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124e83d-981d-424d-8936-24741aa21174 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.674638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124e83d-981d-424d-8936-24741aa21174 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.674911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124e83d-981d-424d-8936-24741aa21174 None admin] PATH_INFO: `/v3/users/f9773ed50bea40ed89ae85fd5125064d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.676124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124e83d-981d-424d-8936-24741aa21174 None admin] RBAC: Authorizing `identity:get_user(user_id=f9773ed50bea40ed89ae85fd5125064d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:54.677599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124e83d-981d-424d-8936-24741aa21174 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.679253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 89/174] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/users/f9773ed50bea40ed89ae85fd5125064d => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:54.680381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01dd7-4909-4c23-95c6-a5e32bac9f27 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.680657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01dd7-4909-4c23-95c6-a5e32bac9f27 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.680927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01dd7-4909-4c23-95c6-a5e32bac9f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.696703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 86/175] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:54.697208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-23e01dd7-4909-4c23-95c6-a5e32bac9f27 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:54.697850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.698418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-23e01dd7-4909-4c23-95c6-a5e32bac9f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:54.765949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 90/176] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:54.777698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25e79-9f21-41cf-85ba-52b0fd14d4bc None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.777698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25e79-9f21-41cf-85ba-52b0fd14d4bc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.777698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25e79-9f21-41cf-85ba-52b0fd14d4bc None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.777698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 91/177] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:54.777698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25e79-9f21-41cf-85ba-52b0fd14d4bc None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.795503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:54.803764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9d9-bc41-4274-af8a-d4ab02e00731 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.837021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455c78c-75d3-4f45-8045-7c30972a5f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.837855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455c78c-75d3-4f45-8045-7c30972a5f32 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.838128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455c78c-75d3-4f45-8045-7c30972a5f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.838400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455c78c-75d3-4f45-8045-7c30972a5f32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.848541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455c78c-75d3-4f45-8045-7c30972a5f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5455c78c-75d3-4f45-8045-7c30972a5f32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:54.856513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:54.857405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:54.858566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 87/178] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:54.859418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70555-3aba-4679-be74-699219a53972 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.859418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70555-3aba-4679-be74-699219a53972 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.859611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70555-3aba-4679-be74-699219a53972 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.861015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 88/179] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:54.863353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70555-3aba-4679-be74-699219a53972 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:54.883740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25e79-9f21-41cf-85ba-52b0fd14d4bc None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.892745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:54.920263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.920928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.921203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.921553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:54.963446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70555-3aba-4679-be74-699219a53972 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:54.991762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:54.993275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:54.998653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb127bc-ce14-4899-9004-07d408d4c2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:54.999317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb127bc-ce14-4899-9004-07d408d4c2fc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:54.999589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb127bc-ce14-4899-9004-07d408d4c2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:54.999853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb127bc-ce14-4899-9004-07d408d4c2fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.011093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.068836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb127bc-ce14-4899-9004-07d408d4c2fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.070380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb127bc-ce14-4899-9004-07d408d4c2fc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.093295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 92/180] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:55.094425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.101163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.170768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 89/181] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:55.172092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.172396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.172763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.189180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:55.190412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:55.195065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01baca-e32a-43a1-8b3f-7dc86ebdfda0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.213095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.230960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.231844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.232125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.232395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.233629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.235196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.236893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 93/182] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.237672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.257497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 90/183] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:55.260936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.320442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.343726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda794d-d664-4810-a9e6-e3108db5cc7b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.360906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3558574-e1b4-477a-99d7-8e366a563336 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.376281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fde06-c042-4759-b5d4-0e0fdf3fb0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.377101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fde06-c042-4759-b5d4-0e0fdf3fb0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.377413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fde06-c042-4759-b5d4-0e0fdf3fb0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.377687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fde06-c042-4759-b5d4-0e0fdf3fb0d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.387978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fde06-c042-4759-b5d4-0e0fdf3fb0d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:55.393473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.394138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.394415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.394684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.395428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:55.395729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-9d9fde06-c042-4759-b5d4-0e0fdf3fb0d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:55.396078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:55.396952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 08:59:55.397986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 08:59:55.398746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.398812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 94/184] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:55.398812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.398812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.398993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.411347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 91/185] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.412354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.421609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:55.422839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:55.466327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.491649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 95/186] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:55.492743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.509654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8c8d8-5559-40c1-959d-f29b24122048 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.535743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.550715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.551849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.552227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.552490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] PATH_INFO: `/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.553724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] RBAC: Authorizing `identity:get_project(project_id=c75c2c1dd31c40b2a6e819c30ad261e9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.555195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.557149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 92/187] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/projects/c75c2c1dd31c40b2a6e819c30ad261e9 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.562174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.597831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fb202-535d-4933-99bb-90d91f4a9d50 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.630932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.631803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.632072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.632337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.633517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.634955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.636635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 96/188] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.637403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.669627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463a07-a5d8-4294-b43c-de6ffb333651 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.685509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.704605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.705295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.705582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.705850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.706702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=dd5ea26c982443d3be385f2d15148248) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:55.707006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.708457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.714545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 93/189] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/role_assignments?user.id=dd5ea26c982443d3be385f2d15148248&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.715439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.742921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944888d-887c-4e9b-86b6-72f071f0b50f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.784103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.785479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.785955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.786475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.788029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.790051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.792075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 97/190] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.793217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.799510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.853681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd94163-1a57-41ce-ade9-3ba542402154 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.897790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.898920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.899208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.899484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.900234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:55.900540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.902050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.911722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 94/191] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.912103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722064-8857-4c0e-8304-b51c16765e2c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:55.912883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:55.929520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:55.954678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:55.955496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:55.955764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:55.956067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] PATH_INFO: `/v3/users/cb7e608b739b4670a35a30e7398068ea` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:55.970341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e608b739b4670a35a30e7398068ea)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:55.971841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:55.973773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 98/192] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/users/cb7e608b739b4670a35a30e7398068ea => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:55.974431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.031203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9ee98-18f6-4fd3-83b6-8b2422899312 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.047671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.065421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.066270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.066549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.066805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.074339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c33fb-8259-4577-9973-a3ebabfa951b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.077757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:56.085776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:56.086690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:56.087475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 95/193] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:56.088549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.115405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.116128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.116407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.116682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.117564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=c75c2c1dd31c40b2a6e819c30ad261e9, user.id=f9773ed50bea40ed89ae85fd5125064d) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:56.117877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.119369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.125464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 99/194] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:55 2022] GET /identity/v3/role_assignments?user.id=f9773ed50bea40ed89ae85fd5125064d&scope.project.id=c75c2c1dd31c40b2a6e819c30ad261e9&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:56.126246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.174207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.206348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b43d-2fd7-4f47-b874-0bc9261eebed None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.245444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.246106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.246388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.246655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.247514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] RBAC: Adding query filter params (role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=f9773ed50bea40ed89ae85fd5125064d) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:56.247823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.249358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.255168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c0f77-b1cc-46d5-8485-be81623d94d2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.256530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 96/195] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/role_assignments?user.id=f9773ed50bea40ed89ae85fd5125064d&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:56.259197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.298709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.299349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.299626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.299896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.300619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.302676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.331977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.335984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 100/196] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 08:59:56 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 08:59:56.336830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.419478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f033734-882b-49ad-b2eb-8ad0d14b211e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.455401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.472973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c4c3-e73c-4312-8038-90160f9cf07d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.477959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.478983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.479257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.479525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] PATH_INFO: `/v3/users/cb7e608b739b4670a35a30e7398068ea` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.481108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e608b739b4670a35a30e7398068ea)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.483368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.485741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 97/197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/users/cb7e608b739b4670a35a30e7398068ea => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:56.489356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.523206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.524304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.524726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.525157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.616172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.617745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.620241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79d50-4006-42fa-bf19-08b634fe17eb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.630485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.668101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.668797 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.669077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.669383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.670174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:56.670719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.671890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.686925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 98/198] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:56.687579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.745387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.768488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 101/199] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:56.770255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:56.818197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e0584-0e63-4c22-bc4c-c07c19a19c4f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.864629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.865695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.866674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.867175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.901250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b4f1-aca1-43d8-a23e-6cea4042c7a5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:56.913058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:56.945178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.946798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.951414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:56.952591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:56.953016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:56.953535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] PATH_INFO: `/v3/users/416246a7715d4ccaaf63eeedac897d94` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:56.955766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] RBAC: Authorizing `identity:get_user(user_id=416246a7715d4ccaaf63eeedac897d94)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:56.957879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:56.960388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 102/200] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/users/416246a7715d4ccaaf63eeedac897d94 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:56.961685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.027742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:57.081537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f962f-3b96-444c-b950-0002b25e8d3d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.087638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 99/201] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:57.088680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.129411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.131010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.131428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.131831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.133680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.135934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.138524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 103/202] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:56 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:57.139814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.163694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:57.196182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1604e-842f-4fdb-9ffc-62d4e3e2b4c8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.237618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.238484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.238871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.239242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.285263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86814463-b25c-42a4-8f7e-bbdc2f591051 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.319332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:57.329100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.330299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.330676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.331044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.332343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.333981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.334504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.335970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 104/203] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:57 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:57.336428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.341965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.432608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:57.447597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6a2d9-82bf-406a-813d-879ff4119ccb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.481119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 100/204] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:57.482594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.489274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.489274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.489274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.489274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.489661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=cb7e608b739b4670a35a30e7398068ea) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:57.489661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.489661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.494644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 105/205] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:57 2022] GET /identity/v3/role_assignments?user.id=cb7e608b739b4670a35a30e7398068ea&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:57.495418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.633257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:57.666876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9882f-a875-48dc-94d8-eaff6ca0b1e8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.705547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a637e6d-19a9-4b1d-b9c4-da25811834c7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.727426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.728118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.728391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.728673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.729548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] RBAC: Adding query filter params (role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=cb7e608b739b4670a35a30e7398068ea) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:57.729860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.731694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.749803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 101/206] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:57 2022] GET /identity/v3/role_assignments?user.id=cb7e608b739b4670a35a30e7398068ea&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:57.774249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78becb7-1830-4ba0-a11d-3468872063e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.775200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78becb7-1830-4ba0-a11d-3468872063e4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.776210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78becb7-1830-4ba0-a11d-3468872063e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.776210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78becb7-1830-4ba0-a11d-3468872063e4 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.777778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78becb7-1830-4ba0-a11d-3468872063e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.779322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78becb7-1830-4ba0-a11d-3468872063e4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.781539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 106/207] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:57 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:57.788569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:57.844321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:57.933779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86207d51-9047-4d46-995f-a3a3429caf66 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:57.968131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:57.968811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:57.969324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:57.969814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:57.970873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] RBAC: Adding query filter params (role.id=95cd352b9b9144ad9f49a86b75b75ec1, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee, user.id=416246a7715d4ccaaf63eeedac897d94) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:57.971196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:57.972782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73c322-5f74-4067-9bc6-b6877e0dfc8d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:57.979380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 102/208] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 08:59:57 2022] GET /identity/v3/role_assignments?user.id=416246a7715d4ccaaf63eeedac897d94&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=95cd352b9b9144ad9f49a86b75b75ec1 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:58.789536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860c172-a55d-47a1-8c80-66111ed58858 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:58.790117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860c172-a55d-47a1-8c80-66111ed58858 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:58.790117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860c172-a55d-47a1-8c80-66111ed58858 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:58.791570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 107/209] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:58.796951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:58.797390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:58.797569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:58.818153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:58.819457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:58.820019 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633cf7b-d5e6-459b-a131-3e8c9297665b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:58.820307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633cf7b-d5e6-459b-a131-3e8c9297665b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:58.820586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633cf7b-d5e6-459b-a131-3e8c9297665b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:58.822245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 108/210] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 08:59:58.827819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:58.828104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:58.828529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:58.846070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:58.847269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:58.887764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 103/211] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:58.910787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:58.925633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 109/212] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 08:59:58.938730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:58.947172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.009758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:59.012942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d67f-399f-4b28-87d4-730eb27cffc8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:59.049905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:59.050905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.051233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.051502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.059562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93725664-50f3-43f3-a367-8933e29cbd86 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:59.065296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 08:59:59.074056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 08:59:59.074934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 08:59:59.075746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 08:59:59.080770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 104/213] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 08:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 08:59:59.081775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.095991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:59.096803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.097078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.097402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.098805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:59.100299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:59.102470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 110/214] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 08:59:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 08:59:59.108361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.178906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:59.191347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9167-6b37-4981-8cdc-0292447e1d6a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:59.220704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6675-77f9-430c-9d1a-2793ad9798bc None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:59.226929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:59.227611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.227885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.228151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.228908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 08:59:59.229254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:59.231113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:59.240923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 105/215] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 08:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:59.246372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.247163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:59.258799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:59.259571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.259919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.260262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.261210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:59.262925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:59.294486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 111/216] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 08:59:59 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 08:59:59.365994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c36a2-d581-4923-bd08-c94871cb1950 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:59.404043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22a091-b024-4735-91af-f125aa413674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:59.405170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22a091-b024-4735-91af-f125aa413674 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.405608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22a091-b024-4735-91af-f125aa413674 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.406036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22a091-b024-4735-91af-f125aa413674 None admin] PATH_INFO: `/v3/users/1b4f7f0714fc4fc3b279d97529614b91` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.421768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22a091-b024-4735-91af-f125aa413674 None admin] RBAC: Authorizing `identity:get_user(user_id=1b4f7f0714fc4fc3b279d97529614b91)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:59.423665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22a091-b024-4735-91af-f125aa413674 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:59.425621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 106/217] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 08:59:59 2022] GET /identity/v3/users/1b4f7f0714fc4fc3b279d97529614b91 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 08:59:59.431633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.545714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a63a1-a371-4e27-b640-26eedc330759 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 08:59:59.581632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 08:59:59.582577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.583021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.583519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.630206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cd46-aa46-44de-8115-7c5cdd0d154e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.630868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cd46-aa46-44de-8115-7c5cdd0d154e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.631437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cd46-aa46-44de-8115-7c5cdd0d154e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.635154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 107/218] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 08:59:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 08:59:59.640014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:59.642641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 08:59:59.643183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 08:59:59.643646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 08:59:59.663704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 08:59:59.664985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 08:59:59.665541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 08:59:59.666865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 08:59:59.669336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:59.757366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 108/219] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 08:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 08:59:59.785862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.798882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 112/220] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 08:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 08:59:59.810289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 08:59:59.961588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:59:59.971722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2686-8ab4-41b9-8fa7-45a4c46ff979 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.018902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.019712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.019990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.020260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.020359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9e88f-13a6-45af-931d-4cb58e4a61ee None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.028843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:00.039084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:00.050658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:00.051542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:00.052311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 109/221] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 08:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:00.061461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.080000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.080876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.081151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.081460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.082650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:00.084100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:00.088082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 113/222] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 08:59:59 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:00.091441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.220030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea97a-7309-48f8-8ece-d220498a32fc None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.237839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a32c5-1499-464a-b71d-9a27573ccda4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.262565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.263986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.264877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.265399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.267149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=1b4f7f0714fc4fc3b279d97529614b91) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:00.267953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:00.270280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8d728-a623-4907-9352-ee1bc7499cbf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:00.277925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 114/223] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/role_assignments?user.id=1b4f7f0714fc4fc3b279d97529614b91&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:00.279495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93387e3e-c52f-44d7-9621-7aafedaff9b4 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.279977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93387e3e-c52f-44d7-9621-7aafedaff9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.280442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93387e3e-c52f-44d7-9621-7aafedaff9b4 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.286839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.286839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.286839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.286839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.287202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:00.287569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 115/224] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:00.289264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.289777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.290245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.292284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:00.293897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:00.319986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 110/225] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:00.321852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:00.323186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:00.326679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.346755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:00.420956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 116/226] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:00.449042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.469451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:00.514685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee66fd-db1e-4d16-bd7e-489a2726f7b4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.560440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080b81d-f164-444e-a7bc-d41146c84177 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.574296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.575193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.575471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.575744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] PATH_INFO: `/v3/users/cb7e608b739b4670a35a30e7398068ea` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.579852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e608b739b4670a35a30e7398068ea)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:00.581354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:00.583031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 111/227] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/users/cb7e608b739b4670a35a30e7398068ea => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:00.591483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.619899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.620721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.621062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.621295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.643289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:00.651785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:00.652654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:00.653475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:00.657440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 117/228] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:00.659580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.662500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:00.806780 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b547-f43f-482c-bc79-7d84236ced15 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.822335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba130-4234-45bc-b15f-f62e498bcebe None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:00.855643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.856575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.857920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.858334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.859554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:00.861360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:00.864776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:00.882944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 118/229] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:00.891200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.900332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:00.906761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:00.908072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:00.908359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:00.908631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:00.910608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:00.912735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:00.914672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 112/230] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:00.924211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:00.991997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:01.075227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3cac-2693-4237-9f18-a8b35fccce98 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:01.086890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c6dd-64fc-4550-9561-392d68f489ae None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:01.122939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:01.124222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:01.124694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:01.125330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/cb7e608b739b4670a35a30e7398068ea/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:01.127745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] RBAC: Authorizing `identity:create_grant(project_id=1626d2f0932e45948d7d0cd109ee66f7, user_id=cb7e608b739b4670a35a30e7398068ea, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:01.129494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:01.138002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:01.138920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:01.139201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:01.139492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] PATH_INFO: `/v3/users/cb7e608b739b4670a35a30e7398068ea` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:01.140872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e608b739b4670a35a30e7398068ea)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:01.142599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:01.144285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 119/231] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:00 2022] GET /identity/v3/users/cb7e608b739b4670a35a30e7398068ea => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:01.147209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 113/232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:00 2022] PUT /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/cb7e608b739b4670a35a30e7398068ea/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:01.153457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:01.331806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec71515-c0a2-440c-9cc0-35a43a9b6d19 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:01.367284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:01.372088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe79a3f-ad5e-4658-8321-b8ecd3867c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:01.372974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe79a3f-ad5e-4658-8321-b8ecd3867c8c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:01.373426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe79a3f-ad5e-4658-8321-b8ecd3867c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:01.373647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe79a3f-ad5e-4658-8321-b8ecd3867c8c None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:01.374981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe79a3f-ad5e-4658-8321-b8ecd3867c8c None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:01.376886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe79a3f-ad5e-4658-8321-b8ecd3867c8c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:01.379013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 120/233] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:01 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:01.385419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:01.451160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:01.532033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f9419-c88f-472f-9ed8-ba96d42adbcf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:01.590653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52def933-572c-4d06-8035-1f7a69b463b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:01.592129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52def933-572c-4d06-8035-1f7a69b463b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:01.592583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52def933-572c-4d06-8035-1f7a69b463b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:01.593066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52def933-572c-4d06-8035-1f7a69b463b9 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/cb7e608b739b4670a35a30e7398068ea/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:01.596821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52def933-572c-4d06-8035-1f7a69b463b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1626d2f0932e45948d7d0cd109ee66f7, user_id=cb7e608b739b4670a35a30e7398068ea, role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:01.599804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52def933-572c-4d06-8035-1f7a69b463b9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:01.623410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 114/234] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:01 2022] PUT /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/cb7e608b739b4670a35a30e7398068ea/roles/1efc231eee0048ba834a4bd3d88a430c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:01.918246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07c73-dad4-45cb-a0e6-4f48f22a76c1 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:01.918733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07c73-dad4-45cb-a0e6-4f48f22a76c1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:01.918733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07c73-dad4-45cb-a0e6-4f48f22a76c1 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:01.920239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 121/235] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:01.926523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce12d5-5dff-44b5-af3d-0dd7818cd211 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:01.926877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce12d5-5dff-44b5-af3d-0dd7818cd211 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:01.927161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce12d5-5dff-44b5-af3d-0dd7818cd211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:01.946478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6fce12d5-5dff-44b5-af3d-0dd7818cd211 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:01.947728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6fce12d5-5dff-44b5-af3d-0dd7818cd211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:02.037883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 115/236] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:02.073842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f07c73-dad4-45cb-a0e6-4f48f22a76c1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:02.151926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa659-2156-4cb3-9d08-327a9a87e252 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.152434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa659-2156-4cb3-9d08-327a9a87e252 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.152506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa659-2156-4cb3-9d08-327a9a87e252 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.154989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 116/237] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:02.164929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.165218 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.165515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.200735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:02.201982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:02.254848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f07c73-dad4-45cb-a0e6-4f48f22a76c1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:02.264036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:02.296384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 117/238] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:02.311787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:02.312671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.312958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.313250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.324126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:02.332506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:02.333407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:02.334319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 122/239] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:02.339814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:02.348571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:02.427915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:02.474251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead134-5faa-4ea7-a88a-bc0c317b336d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:02.511569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:02.512506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.512790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.513059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.513845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:02.514151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:02.515552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:02.530852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 123/240] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:02.536845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:02.543401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfefe7-850a-46e2-9150-3bf1d783310f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:02.599327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:02.600149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.600430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.600705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.606104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:02.607591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:02.609760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 118/241] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:02.615374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:02.648191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3a19d-82f0-4da9-bef3-9270efa7a947 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:02.672423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:02.684847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:02.685770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.686049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.686330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] PATH_INFO: `/v3/users/ed6a25698e094f3da388dd2616a23f14` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.700170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] RBAC: Authorizing `identity:get_user(user_id=ed6a25698e094f3da388dd2616a23f14)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:02.701682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:02.703582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 124/242] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:02 2022] GET /identity/v3/users/ed6a25698e094f3da388dd2616a23f14 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:02.703982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:02.710255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:02.823698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402627e5-d2a6-4c8b-807c-f989d236d87e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:02.859797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:02.860606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.860887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.861166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.907167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432f40-77b5-404d-b5f9-a1a2e9509257 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:02.914694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:02.934646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:02.936145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:02.948686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063839-922d-463e-ae8d-8815f638bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:02.949675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063839-922d-463e-ae8d-8815f638bb8a None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.950163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063839-922d-463e-ae8d-8815f638bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.950682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063839-922d-463e-ae8d-8815f638bb8a None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.951685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063839-922d-463e-ae8d-8815f638bb8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:02.953535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063839-922d-463e-ae8d-8815f638bb8a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:02.976534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 119/243] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:02 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:00:02.978238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3cdbf-f19e-42fb-bf84-fdb3f515a619 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.979334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3cdbf-f19e-42fb-bf84-fdb3f515a619 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.979859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3cdbf-f19e-42fb-bf84-fdb3f515a619 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:02.982529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 120/244] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:02.988917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:02.989203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:02.989501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.015240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:03.017971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:03.065354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 125/245] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:03.072795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.121603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 121/246] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:03.144168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.200282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:03.215033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:03.239043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e5f44-fe82-4152-a3dd-d88f3298bdf4 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:03.282737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7103-6d02-4794-9c50-05db095c6732 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:03.283645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:03.285015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.286387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.286839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.288293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:03.290051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:03.292780 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 126/247] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:03 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:03.302498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.335782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:03.336592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.336867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.337134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.353364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:03.364950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:03.365941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:03.366706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 122/248] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:03.374471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.447519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e546-9bd2-43c9-a5d9-0cd4fc142aa3 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:03.498530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:03.504965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:03.505997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.506426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.506845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.507954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] RBAC: Adding query filter params (role.id=95cd352b9b9144ad9f49a86b75b75ec1, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=ed6a25698e094f3da388dd2616a23f14) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:03.508408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:03.510225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:03.512650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e38ce-0ae2-4e42-be4f-c18916c4fabd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:03.517453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 127/249] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:03 2022] GET /identity/v3/role_assignments?user.id=ed6a25698e094f3da388dd2616a23f14&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=95cd352b9b9144ad9f49a86b75b75ec1 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:03.558471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:03.559178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.559508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.559782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.560604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:03.560913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:03.562381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:03.574260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 123/250] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:03.580373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.598542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:03.708806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790fb8b-0311-4fb6-bd9c-4e6923c82082 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:03.744851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:03.745771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.746040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.746304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] PATH_INFO: `/v3/users/1b4f7f0714fc4fc3b279d97529614b91` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.747537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] RBAC: Authorizing `identity:get_user(user_id=1b4f7f0714fc4fc3b279d97529614b91)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:03.748999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:03.751075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 128/251] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:03 2022] GET /identity/v3/users/1b4f7f0714fc4fc3b279d97529614b91 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:03.756606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.905113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b1e22-eb18-4584-acec-aca5e72e1b3c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:03.951879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65c05a-db0b-44df-86c5-0aa731d0b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:03.952752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c05a-db0b-44df-86c5-0aa731d0b562 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.953028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c05a-db0b-44df-86c5-0aa731d0b562 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.953419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c05a-db0b-44df-86c5-0aa731d0b562 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.957962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c05a-db0b-44df-86c5-0aa731d0b562 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:03.959475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c05a-db0b-44df-86c5-0aa731d0b562 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:03.961412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 124/252] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:03 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:03.967157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:03.971422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc6d3-6ba6-4995-bc19-73ed51ed6c90 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.971707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc6d3-6ba6-4995-bc19-73ed51ed6c90 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.971981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc6d3-6ba6-4995-bc19-73ed51ed6c90 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:03.973533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 125/253] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:03.991264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:03.991553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:03.991823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.016933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:04.018239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:04.058369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:04.129021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:04.151753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6810-7d54-45bb-932e-f87afb205b70 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:04.171547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 126/254] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:04.195912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:04.197208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.197732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.198255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/1b4f7f0714fc4fc3b279d97529614b91/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.200438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] RBAC: Authorizing `identity:create_grant(project_id=1626d2f0932e45948d7d0cd109ee66f7, user_id=1b4f7f0714fc4fc3b279d97529614b91, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:04.202136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:04.212066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:04.226346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 129/255] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:03 2022] PUT /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/1b4f7f0714fc4fc3b279d97529614b91/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:04.334108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2a63-1e9e-49ed-8441-f53baaedacb0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:04.372676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a57cc-20ca-48e2-a146-42b84b263ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:04.373524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a57cc-20ca-48e2-a146-42b84b263ebe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.373798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a57cc-20ca-48e2-a146-42b84b263ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.374067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a57cc-20ca-48e2-a146-42b84b263ebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.386310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a57cc-20ca-48e2-a146-42b84b263ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-560a57cc-20ca-48e2-a146-42b84b263ebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:04.394592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:04.395810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:04.396829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 127/256] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:04.406283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:04.457887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda190-fd48-40ae-be97-13acaf147a44 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.458244 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda190-fd48-40ae-be97-13acaf147a44 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.458430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda190-fd48-40ae-be97-13acaf147a44 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.461003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 128/257] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:04.465539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.465766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.466017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.497770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:04.498976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:04.502320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:04.546839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c970-7a0c-4e12-b41d-e51a3c282f9c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:04.584542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:04.585692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.586190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.586652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.587752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:04.588287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:04.589973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:04.599438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 130/258] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:04.605482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:04.608632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:04.609774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 129/259] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:04.655003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:04.721112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc46a6-db08-4247-a16f-9480a531765a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:04.762548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:04.763923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.764429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.764901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] PATH_INFO: `/v3/users/cb7e608b739b4670a35a30e7398068ea` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.766931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e608b739b4670a35a30e7398068ea)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:04.769535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:04.772062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 131/260] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:04 2022] GET /identity/v3/users/cb7e608b739b4670a35a30e7398068ea => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:04.778747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:04.813261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e4852-f5af-4402-a6b7-fad4c596a2fe None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:04.873975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:04.874829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:04.875222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:04.875607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:04.891022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:04.909627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:04.914786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:04.915669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:04.917376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 130/261] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:04.921853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:04.922986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:05.027742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66abd4-d255-4def-a166-06ffb908135d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:05.115581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:05.116260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:05.116538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:05.116810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:05.145336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfc182-6e3d-4356-849a-a1680a0a4e57 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:05.223009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:05.223763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:05.223972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:05.224246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:05.225009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:05.225337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:05.226755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:05.244461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 131/262] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:05.250219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:05.254806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:05.256515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:05.341105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:05.377026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 132/263] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:05.385492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:05.399114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:05.456277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8368d2-e2cb-479e-a6de-eaecb505e3ba None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:05.513216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:05.514501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:05.514924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:05.515340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] PATH_INFO: `/v3/users/cb7e608b739b4670a35a30e7398068ea` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:05.518183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e608b739b4670a35a30e7398068ea)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:05.519823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:05.521669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 132/264] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:05 2022] GET /identity/v3/users/cb7e608b739b4670a35a30e7398068ea => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:05.527139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:05.613255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293573-6332-481d-a0cb-e00e0a0493fa None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:05.691900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:05.693474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:05.694028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:05.694561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:05.696509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5e21-9b99-4b10-a955-c97f2aac02f2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:05.697351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:05.699216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:05.701517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 133/265] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:05 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:05.708773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:05.778610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:05.784489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:05.788561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47ac8-1cc8-40a0-b2c6-9461957af51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:05.789262 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47ac8-1cc8-40a0-b2c6-9461957af51f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:05.793257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47ac8-1cc8-40a0-b2c6-9461957af51f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:05.793257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47ac8-1cc8-40a0-b2c6-9461957af51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:05.860910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919efb8e-81a2-44e8-b405-f58c6aaaea5d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:05.896271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:05.896845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:05.897120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:05.897414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:05.898264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=cb7e608b739b4670a35a30e7398068ea) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:05.898568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:05.899998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:05.906071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 134/266] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:05 2022] GET /identity/v3/role_assignments?user.id=cb7e608b739b4670a35a30e7398068ea&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:05.918592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a47ac8-1cc8-40a0-b2c6-9461957af51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:05.920229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a47ac8-1cc8-40a0-b2c6-9461957af51f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:06.094650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 133/267] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:00:06.101002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:06.265714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cab85c-59f6-489d-a6c4-a142fa6228df None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:06.267395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:06.276171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72642205-5221-43eb-a4f7-267f50342bb4 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.276699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72642205-5221-43eb-a4f7-267f50342bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.276699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72642205-5221-43eb-a4f7-267f50342bb4 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.278174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 134/268] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:06.283738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.284023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.284296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.319076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:06.320287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:06.327532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:06.328545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.328823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.329089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.330362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:06.331821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:06.333900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 135/269] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:06 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:06.339594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:06.349651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:06.421752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 135/270] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:06.440489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:06.524012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0683d-acd4-43d9-b76c-13115980b6fb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:06.573221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:06.574214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.574639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.575054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.576255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] RBAC: Adding query filter params (role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=cb7e608b739b4670a35a30e7398068ea) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:06.576736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:06.579495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c847-b8bc-4161-b1b9-2d1f0921b927 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:06.580764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31c27-444c-479e-8b62-b3f7f683cef2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:06.588672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 136/271] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:06 2022] GET /identity/v3/role_assignments?user.id=cb7e608b739b4670a35a30e7398068ea&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:06.590445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48123ba-eec2-4f38-9d10-2a8e5f27271c None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.590933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48123ba-eec2-4f38-9d10-2a8e5f27271c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.591405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48123ba-eec2-4f38-9d10-2a8e5f27271c None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.592850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 137/272] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:06.607146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc9c83-076b-44c2-9410-478e40b949b4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.607825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc9c83-076b-44c2-9410-478e40b949b4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.608299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc9c83-076b-44c2-9410-478e40b949b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.630192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-32bc9c83-076b-44c2-9410-478e40b949b4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:06.631668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-32bc9c83-076b-44c2-9410-478e40b949b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:06.633385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc189353-d6be-4d54-9e44-17e40eee942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:06.634366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189353-d6be-4d54-9e44-17e40eee942f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.634747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189353-d6be-4d54-9e44-17e40eee942f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.635118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189353-d6be-4d54-9e44-17e40eee942f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.647667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc189353-d6be-4d54-9e44-17e40eee942f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-fc189353-d6be-4d54-9e44-17e40eee942f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:06.656020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:06.657455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:06.658433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:06.660323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 136/273] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:06.661764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004f21-31a4-4f49-9d03-f2af333ffc9d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.662125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004f21-31a4-4f49-9d03-f2af333ffc9d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.662465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004f21-31a4-4f49-9d03-f2af333ffc9d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.664246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 137/274] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:06.669190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004f21-31a4-4f49-9d03-f2af333ffc9d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:06.693645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:06.699728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:06.729141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 138/275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:06.731190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.731540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.731865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.754701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:06.756282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:06.814063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004f21-31a4-4f49-9d03-f2af333ffc9d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:06.844965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 139/276] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:06.846341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:06.856066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:06.856738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.857013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.857352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:06.858573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:06.859914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:06.861478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:06.871004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 138/277] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:06.876787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:06.955243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:06.962292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62116b-d37c-458d-86c0-87e97fa8089e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:06.976164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:06.996060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260355-c667-4199-b6f1-8cd64ab25edc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:06.998320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:06.999159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:06.999406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:06.999679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.010891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:07.019720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:07.020624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:07.021618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 140/278] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:07.022246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.037061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.037983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.038258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.038528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] PATH_INFO: `/v3/users/ed6a25698e094f3da388dd2616a23f14` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.039714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] RBAC: Authorizing `identity:get_user(user_id=ed6a25698e094f3da388dd2616a23f14)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.041187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.043014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 139/279] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:06 2022] GET /identity/v3/users/ed6a25698e094f3da388dd2616a23f14 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:07.043630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.135525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b238c5e-5fb9-445a-bda0-0feab140af76 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.159275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdea7d-00b5-441f-82c7-e4a2426dd488 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.178455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.179304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.179578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.179943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.181103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.182625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.184225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 141/280] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:07.184976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.201542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.202230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.202498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.202767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.203630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:07.204012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.205352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.211641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:07.214294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 140/281] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:07.215042 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.230595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:07.304254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26865dcd-53a9-4586-944f-72eec29982d6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.329917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d010a7-3fc8-4264-8fb2-4deae504fdae None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.345826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.346682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.346956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.347228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.348382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.349981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.351684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 142/282] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:07.352430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.372885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.373629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.373904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.374175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.374909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.376512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.405354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 141/283] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:07 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:07.405354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.463971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:07.475776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c859-b54a-4569-84e9-e918ebaf0eb1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.499355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:07.527523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48ada-6919-409e-bc57-eda6db40666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.528620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48ada-6919-409e-bc57-eda6db40666f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.528903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48ada-6919-409e-bc57-eda6db40666f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.529171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48ada-6919-409e-bc57-eda6db40666f None admin] PATH_INFO: `/v3/users/3814eca8d23e4f84b1cff494e651c2e2` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.543941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4ffbc-5a46-4d7c-b4de-e03739c38eca None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.548884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48ada-6919-409e-bc57-eda6db40666f None admin] RBAC: Authorizing `identity:get_user(user_id=3814eca8d23e4f84b1cff494e651c2e2)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.550401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48ada-6919-409e-bc57-eda6db40666f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.553272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 143/284] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/users/3814eca8d23e4f84b1cff494e651c2e2 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:07.554514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3179d-ae4d-41e9-8e9e-059f935a8af4 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.554799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3179d-ae4d-41e9-8e9e-059f935a8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.555071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3179d-ae4d-41e9-8e9e-059f935a8af4 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.556546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 144/285] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:07.561895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3179d-ae4d-41e9-8e9e-059f935a8af4 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.593186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac601d9-4998-4ac5-97b3-a5396248eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.594183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac601d9-4998-4ac5-97b3-a5396248eedb None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.594458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac601d9-4998-4ac5-97b3-a5396248eedb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.594723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac601d9-4998-4ac5-97b3-a5396248eedb None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/ed6a25698e094f3da388dd2616a23f14/roles/95cd352b9b9144ad9f49a86b75b75ec1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.596745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac601d9-4998-4ac5-97b3-a5396248eedb None admin] RBAC: Authorizing `identity:create_grant(project_id=1626d2f0932e45948d7d0cd109ee66f7, user_id=ed6a25698e094f3da388dd2616a23f14, role_id=95cd352b9b9144ad9f49a86b75b75ec1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.598146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac601d9-4998-4ac5-97b3-a5396248eedb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.617501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 142/286] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:07 2022] PUT /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/users/ed6a25698e094f3da388dd2616a23f14/roles/95cd352b9b9144ad9f49a86b75b75ec1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:07.619027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.619407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.619600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.639074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:07.642426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:07.689008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3179d-ae4d-41e9-8e9e-059f935a8af4 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.734232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 143/287] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:07.735151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.735945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.736220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.736487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.738491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, user.id=3814eca8d23e4f84b1cff494e651c2e2, scope.system=all) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:07.738491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:07.739382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:07.747433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 145/288] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/role_assignments?user.id=3814eca8d23e4f84b1cff494e651c2e2&scope.system=all&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:07.760866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.840535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:07.893432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e393cde-6812-4ef5-8c50-3a3db06081ad None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:07.930769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:07.931874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:07.932324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:07.932763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:07.944217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:07.952311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:07.953295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:07.954132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:07.958994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 144/289] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:07.962796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:07.982990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:08.069935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b904c-1e67-4b7c-872a-a9a42779f2e7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:08.107046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:08.108010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:08.108437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:08.108850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:08.110189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:08.110698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:08.112226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:08.121598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 146/290] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:08.127898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:08.257897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dece8-7ff4-42f3-b229-ba1824c44bee None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:08.288770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:08.314973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:08.315865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:08.316142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:08.316414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] PATH_INFO: `/v3/users/1b4f7f0714fc4fc3b279d97529614b91` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:08.317668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] RBAC: Authorizing `identity:get_user(user_id=1b4f7f0714fc4fc3b279d97529614b91)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:08.319144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:08.325338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 145/291] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:08 2022] GET /identity/v3/users/1b4f7f0714fc4fc3b279d97529614b91 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:08.327109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:08.405592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:08.431971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fccc6-7074-4442-9ba0-0031446350c4 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:08.467598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:08.468270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:08.468549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:08.468878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:08.540885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:08.542287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:08.629601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:08.645940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 147/292] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:00:08.651885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:08.789857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c004b0-65c1-45bd-bd37-0d012417957a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:08.836688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc94e19-62cb-4b7b-9361-eda17ebb3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:08.837941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc94e19-62cb-4b7b-9361-eda17ebb3611 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:08.838401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc94e19-62cb-4b7b-9361-eda17ebb3611 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:08.838851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc94e19-62cb-4b7b-9361-eda17ebb3611 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:08.840249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc94e19-62cb-4b7b-9361-eda17ebb3611 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:08.841988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc94e19-62cb-4b7b-9361-eda17ebb3611 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:08.843938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 146/293] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:08 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:08.850290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:08.966814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a0bb-cc7d-406d-ab83-39d9e11f926b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:09.002736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:09.003391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:09.003673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:09.003948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:09.004781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=1b4f7f0714fc4fc3b279d97529614b91) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:09.005090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:09.006573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084a012-67a6-4252-a8f4-674e33492e75 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:09.012506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 148/294] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:08 2022] GET /identity/v3/role_assignments?user.id=1b4f7f0714fc4fc3b279d97529614b91&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:10.021070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca6b6f-5f95-4153-ae4d-3bfb2e22f8a0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.021654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca6b6f-5f95-4153-ae4d-3bfb2e22f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.021923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca6b6f-5f95-4153-ae4d-3bfb2e22f8a0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.023398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 147/295] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:10.029206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa17d-8f61-4fa4-a586-caf12e1d123d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.030270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa17d-8f61-4fa4-a586-caf12e1d123d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.030765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa17d-8f61-4fa4-a586-caf12e1d123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.048013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a3efa17d-8f61-4fa4-a586-caf12e1d123d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:10.049548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a3efa17d-8f61-4fa4-a586-caf12e1d123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:10.081266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.122099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 149/296] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:10.135643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2239-2774-4341-a537-3adf80ce45d2 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.136243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2239-2774-4341-a537-3adf80ce45d2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.136718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2239-2774-4341-a537-3adf80ce45d2 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.138643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 148/297] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:10.144230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d8d40-04c9-410a-8cfd-a16acbd5fa8d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.144368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2239-2774-4341-a537-3adf80ce45d2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.144879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d8d40-04c9-410a-8cfd-a16acbd5fa8d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.145393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d8d40-04c9-410a-8cfd-a16acbd5fa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.167734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-991d8d40-04c9-410a-8cfd-a16acbd5fa8d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:10.168999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-991d8d40-04c9-410a-8cfd-a16acbd5fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:10.208686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.237188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 150/298] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:10.240962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e5da-14e8-49b8-b951-a72f61b24151 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.240962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e5da-14e8-49b8-b951-a72f61b24151 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.240962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e5da-14e8-49b8-b951-a72f61b24151 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.240962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 151/299] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:10.241598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4e93-3fe6-4f44-abc3-2f0b423c4514 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.241875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4e93-3fe6-4f44-abc3-2f0b423c4514 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.242138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4e93-3fe6-4f44-abc3-2f0b423c4514 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.243467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 152/300] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:10.248901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.249272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.249559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.264942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2239-2774-4341-a537-3adf80ce45d2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.268484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:10.269688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:10.298857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5e2e-05e5-4356-b443-afc1673a7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.299662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5e2e-05e5-4356-b443-afc1673a7111 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.299937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5e2e-05e5-4356-b443-afc1673a7111 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.300203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5e2e-05e5-4356-b443-afc1673a7111 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.310737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c5e2e-05e5-4356-b443-afc1673a7111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-1c1c5e2e-05e5-4356-b443-afc1673a7111 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:10.318542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:10.319383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 149/301] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:10.325060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.325815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.325815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.338064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:10.338518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 153/302] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:10.339228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:10.339346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.372508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.413784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 150/303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:10.413784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.451667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9cfa-5442-41d3-af58-d55104d8f60f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.452796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.488466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.489301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.489579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.489859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.500222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:10.507991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:10.509053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:10.510086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:10.510706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384aed-dcc7-4a4c-a563-baac3f926bb5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.513394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 154/304] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:10.514417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.544301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.544969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.545270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.545539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.546283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:10.546636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:10.548139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:10.556198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 151/305] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:10.556903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.605404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.618140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072f1e-3424-49f8-af60-c63e3b4ad03c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.651592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.652383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.652659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.652929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.654122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:10.655577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:10.656917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d25b86-80e0-4c8e-bc63-08538e7612a8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.657492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 155/306] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:10.658258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.668303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.694518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.695310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.695585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.695853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.705883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:10.713431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:10.714294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:10.715062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 152/307] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:10.715701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.762739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bfcb-2356-4c6a-871b-fb829bcd2b3e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.795977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.796633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.797021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.797322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.798157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:10.798456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:10.799837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:10.807887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 156/308] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:10.808640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.827685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.828275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3d26b-fc8f-4ddc-9d7d-293ea6cfe413 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.865176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.866084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.866366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.866635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] PATH_INFO: `/v3/users/3814eca8d23e4f84b1cff494e651c2e2` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.867838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] RBAC: Authorizing `identity:get_user(user_id=3814eca8d23e4f84b1cff494e651c2e2)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:10.869353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:10.870978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 153/309] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/users/3814eca8d23e4f84b1cff494e651c2e2 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:10.871733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.906104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:10.911682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5449-e231-4a6d-85f1-bd7c9d6f0d69 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:10.947681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d017c-8260-487f-bf00-3865c6505def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:10.948339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d017c-8260-487f-bf00-3865c6505def None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:10.948612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d017c-8260-487f-bf00-3865c6505def None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:10.948881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d017c-8260-487f-bf00-3865c6505def None admin] PATH_INFO: `/v3/groups` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:10.949604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d017c-8260-487f-bf00-3865c6505def None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:10.951046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d017c-8260-487f-bf00-3865c6505def None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:10.965635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 157/310] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Jul 20 09:00:10 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:10.966429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d017c-8260-487f-bf00-3865c6505def None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:10.976950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceed8c-9a88-4ddc-a113-136f31fc0404 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.016990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.017788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.018273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.018377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.019088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:11.019404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.020815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.035076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 154/311] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:11.035076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:11.065511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:11.091365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d017c-8260-487f-bf00-3865c6505def None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.129671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.130831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.131103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.131366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] PATH_INFO: `/v3/users/ed6a25698e094f3da388dd2616a23f14` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.132551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] RBAC: Authorizing `identity:get_user(user_id=ed6a25698e094f3da388dd2616a23f14)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.134023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.135669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 158/312] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:10 2022] GET /identity/v3/users/ed6a25698e094f3da388dd2616a23f14 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:11.136493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:11.143621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:11.150599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2554a-5254-45d9-aa78-abd5f3e2b1e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.185469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.186335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.186625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.186879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] PATH_INFO: `/v3/system/users/3814eca8d23e4f84b1cff494e651c2e2/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.188467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3814eca8d23e4f84b1cff494e651c2e2, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.189872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.199897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 155/313] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Jul 20 09:00:11 2022] PUT /identity/v3/system/users/3814eca8d23e4f84b1cff494e651c2e2/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:11.204841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:11.253816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eed78-9462-4d1f-b31c-a49281fe2620 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.298546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.299609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.300000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.300337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] PATH_INFO: `/v3/users/783a43658a76425e9c919bf7cb144b17` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.321061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] RBAC: Authorizing `identity:get_user(user_id=783a43658a76425e9c919bf7cb144b17)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.322604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.324553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 159/314] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:11 2022] GET /identity/v3/users/783a43658a76425e9c919bf7cb144b17 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:11.330972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:11.336199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:11.344329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81d2b-74d8-4e38-a8e2-9e18d3245a65 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.382247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.382912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.383193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.383466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.418748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:11.449286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f61e89-8853-4214-b465-8ecabec1ec1f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.471220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.472702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.490986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.491918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.492202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.492469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.493503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] RBAC: Adding query filter params (role.id=95cd352b9b9144ad9f49a86b75b75ec1, user.id=783a43658a76425e9c919bf7cb144b17, scope.system=all) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:11.493815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.495555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.502902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 160/315] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 20 09:00:11 2022] GET /identity/v3/role_assignments?user.id=783a43658a76425e9c919bf7cb144b17&scope.system=all&role.id=95cd352b9b9144ad9f49a86b75b75ec1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:11.591361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 156/316] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:11.600850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:11.673285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:11.708117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f329ed1-8cb7-4fd3-bf42-481c015003ac None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.742895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b6bab-5aca-48f6-90c3-fa18f6de6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.744119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b6bab-5aca-48f6-90c3-fa18f6de6848 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.744623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b6bab-5aca-48f6-90c3-fa18f6de6848 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.745085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b6bab-5aca-48f6-90c3-fa18f6de6848 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.746494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b6bab-5aca-48f6-90c3-fa18f6de6848 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.748116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b6bab-5aca-48f6-90c3-fa18f6de6848 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.750359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 161/317] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:11 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:11.756581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:11.820857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:11.862742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93579b-0a25-4ed1-b461-a07db4d1f6f6 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:11.897568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:11.898238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:11.898516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:11.898788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:11.899625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] RBAC: Adding query filter params (role.id=95cd352b9b9144ad9f49a86b75b75ec1, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7, user.id=ed6a25698e094f3da388dd2616a23f14) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:11.899936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:11.901423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334572e-ae68-460a-98bd-9e80ec7b79b8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:11.908317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 157/318] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:11 2022] GET /identity/v3/role_assignments?user.id=ed6a25698e094f3da388dd2616a23f14&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=95cd352b9b9144ad9f49a86b75b75ec1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:13.059775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b1e7-3b83-4fc6-b3be-8c7754c3e755 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.060301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b1e7-3b83-4fc6-b3be-8c7754c3e755 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.060301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b1e7-3b83-4fc6-b3be-8c7754c3e755 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.061841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 162/319] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:13.067572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073666-f26d-4eba-b5f3-ee423fbccb42 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.068025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073666-f26d-4eba-b5f3-ee423fbccb42 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.068142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073666-f26d-4eba-b5f3-ee423fbccb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.086020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dc073666-f26d-4eba-b5f3-ee423fbccb42 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:13.087219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dc073666-f26d-4eba-b5f3-ee423fbccb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:13.158517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 158/320] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:13.181534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1b1e7-3b83-4fc6-b3be-8c7754c3e755 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.288129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1b1e7-3b83-4fc6-b3be-8c7754c3e755 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:13.322085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611655c-413e-45de-8e88-df70f6ab2a69 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.322283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611655c-413e-45de-8e88-df70f6ab2a69 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.322544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611655c-413e-45de-8e88-df70f6ab2a69 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.323945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 159/321] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:13.329443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.329743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.330019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.332598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:13.333431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.333709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.333963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.335121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:13.336586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:13.338306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 163/322] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:13.344164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.347685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:13.348207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:13.348999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:13.403060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:13.421397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 160/323] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:13.444798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.455672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e4de4-877c-477e-ba96-b56c221928c7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:13.491756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a90e3-c8da-4234-8634-879c04057cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:13.492397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a90e3-c8da-4234-8634-879c04057cd7 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.492677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a90e3-c8da-4234-8634-879c04057cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.492946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a90e3-c8da-4234-8634-879c04057cd7 None admin] PATH_INFO: `/v3/groups` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.493671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a90e3-c8da-4234-8634-879c04057cd7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:13.495108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a90e3-c8da-4234-8634-879c04057cd7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:13.517756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 164/324] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Jul 20 09:00:13 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:00:13.555317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4c35-bebd-47bb-b39b-50f262367b58 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:13.583914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee768-345b-400b-acdf-52a4caac0a68 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.584653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee768-345b-400b-acdf-52a4caac0a68 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.584945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee768-345b-400b-acdf-52a4caac0a68 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.586724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 165/325] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:13.592362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.592642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.593046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.596331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:13.597143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.597449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.597721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.612005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:13.612236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:13.613268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:13.621691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:13.622651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:13.623409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 161/326] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:13.629582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.681032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:13.688295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:13.698304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 166/327] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:13.721297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.748129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67886a-a6c6-49a8-908f-3795f7e20c3d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:13.792856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:13.793593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.793863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.794101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.794855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:13.795153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:13.796546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:13.807355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 162/328] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:13.811926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.848384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792ed94-7f27-4a0d-baae-e56f8dfd056b None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:13.886215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:13.887013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.887284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.887546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.902087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:13.911930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:13.912830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:13.913661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:13.914235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 167/329] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:13.919977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.928762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f0ad-56c6-416a-a379-e9aff208a960 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:13.936741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:13.977807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:13.978757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:13.979032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:13.979301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] PATH_INFO: `/v3/users/3814eca8d23e4f84b1cff494e651c2e2` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:13.981903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] RBAC: Authorizing `identity:get_user(user_id=3814eca8d23e4f84b1cff494e651c2e2)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:13.983143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:13.985217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 163/330] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/users/3814eca8d23e4f84b1cff494e651c2e2 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:13.993478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:13.996529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:14.054722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faae6a-c22b-4e4c-b3df-08c1848c4296 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:14.098007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:14.098947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:14.099253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:14.099626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:14.100546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:14.100954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:14.102943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:14.119177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 168/331] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:14.120460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:14.121959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd941-6853-4ad1-9b8f-2869bb776578 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:14.162330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:14.164197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:14.164699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:14.165178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:14.166327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] RBAC: Adding query filter params (role.id=550e64942da9455c93c07ee3fa124eb6, user.id=3814eca8d23e4f84b1cff494e651c2e2, scope.system=all) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:14.166925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:14.168670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:14.184629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 164/332] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 20 09:00:13 2022] GET /identity/v3/role_assignments?user.id=3814eca8d23e4f84b1cff494e651c2e2&scope.system=all&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:14.237997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04325f0-e7a3-4034-bea9-4a577f04a091 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:14.264341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:14.277014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90f8cc-10f6-489f-886a-d0b908837456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:14.277989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90f8cc-10f6-489f-886a-d0b908837456 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:14.278539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90f8cc-10f6-489f-886a-d0b908837456 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:14.279179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90f8cc-10f6-489f-886a-d0b908837456 None admin] PATH_INFO: `/v3/users/783a43658a76425e9c919bf7cb144b17` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:14.280597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90f8cc-10f6-489f-886a-d0b908837456 None admin] RBAC: Authorizing `identity:get_user(user_id=783a43658a76425e9c919bf7cb144b17)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:14.282654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90f8cc-10f6-489f-886a-d0b908837456 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:14.284401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 169/333] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:14 2022] GET /identity/v3/users/783a43658a76425e9c919bf7cb144b17 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:14.290401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:14.331611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:14.416937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d196b6-7d69-487f-a318-ee892724d10b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:14.460892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ad44-4710-4243-8470-a75487690ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:14.461808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ad44-4710-4243-8470-a75487690ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:14.462086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ad44-4710-4243-8470-a75487690ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:14.462357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ad44-4710-4243-8470-a75487690ee6 None admin] PATH_INFO: `/v3/system/users/783a43658a76425e9c919bf7cb144b17/roles/95cd352b9b9144ad9f49a86b75b75ec1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:14.463885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586ad44-4710-4243-8470-a75487690ee6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=783a43658a76425e9c919bf7cb144b17, role_id=95cd352b9b9144ad9f49a86b75b75ec1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:14.465358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586ad44-4710-4243-8470-a75487690ee6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:14.475515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 165/334] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Jul 20 09:00:14 2022] PUT /identity/v3/system/users/783a43658a76425e9c919bf7cb144b17/roles/95cd352b9b9144ad9f49a86b75b75ec1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:16.183264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04ade-67f2-4cb1-8e4b-8b23a5434f8b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.184318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04ade-67f2-4cb1-8e4b-8b23a5434f8b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.184817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04ade-67f2-4cb1-8e4b-8b23a5434f8b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.186754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 170/335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:16.192217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.192661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.192862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.215453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:16.216665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:16.247865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a937-059e-4b65-b556-0187bb1bb56c None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.248549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a937-059e-4b65-b556-0187bb1bb56c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.249011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a937-059e-4b65-b556-0187bb1bb56c None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.252333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 171/336] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:16.259923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.260501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.261073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.279571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:16.281137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:16.323517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 166/337] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:16.363799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:16.373344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 172/338] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:16.390428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:16.427018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:16.584273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf541a7-5e61-458e-9bb3-ee9567cc5e52 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:16.607184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d544f2-cdbe-46b1-8a4b-8dbefdacc7a4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:16.618660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:16.656771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:16.657714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.657989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.658255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.674700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:16.675527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.675802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.676066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.678701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:16.689497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:16.690390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:16.691154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:16.691740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:16.691809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 173/339] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:16.698539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:16.700527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:16.702466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:16.704655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 167/340] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:16.706232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:16.709433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:16.864036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:16.867568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f01f7-cb6e-4dcf-b173-6fc4d5e5aa21 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:16.904142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a758d-0677-498b-bfd8-7bce8097258f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:16.920715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:16.921429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.922111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.922402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.923311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:16.923751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:16.925148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:16.939958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 174/341] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:16.951290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:16.965993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:16.966906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:16.967430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:16.967839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:16.968967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:16.969437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:16.970956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:16.981108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 168/342] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:16.988705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:16.995954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.091085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980926b-f166-47ee-814d-cd0a86e28154 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.107846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4fee8-d639-4e9f-8641-cc9e876d7839 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.128461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2f20-104f-41bf-9659-3364be28c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.129063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2f20-104f-41bf-9659-3364be28c6fc None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.129675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2f20-104f-41bf-9659-3364be28c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.129675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2f20-104f-41bf-9659-3364be28c6fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.154474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ebf0-1dbd-40e4-8ff9-63b1c6e5a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.155462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ebf0-1dbd-40e4-8ff9-63b1c6e5a9bc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.155889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ebf0-1dbd-40e4-8ff9-63b1c6e5a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.156358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ebf0-1dbd-40e4-8ff9-63b1c6e5a9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.184415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.203095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2f20-104f-41bf-9659-3364be28c6fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:17.204568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2f20-104f-41bf-9659-3364be28c6fc None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:17.241697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.257715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012ebf0-1dbd-40e4-8ff9-63b1c6e5a9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:17.259736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012ebf0-1dbd-40e4-8ff9-63b1c6e5a9bc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:17.336456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 175/343] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:00:17.337902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507926-5ccd-4196-9f59-c3fb8e59f1c9 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.338346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507926-5ccd-4196-9f59-c3fb8e59f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.338754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507926-5ccd-4196-9f59-c3fb8e59f1c9 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.345631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 176/344] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:17.346791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507926-5ccd-4196-9f59-c3fb8e59f1c9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.390139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 169/345] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:17.392111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.392535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.392953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.412907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:17.414514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:17.458120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507926-5ccd-4196-9f59-c3fb8e59f1c9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.462094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.491030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 170/346] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:17.492267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.497547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.498691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.499104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.499552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.501058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:17.502769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:17.504676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 177/347] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:17.524066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.529454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.608465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fceeb-0a17-4669-b1a0-e59afa775ed1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.643035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374806da-1d94-4e27-ad3d-463c04f2a762 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.645690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.646700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.646972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.647305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.648558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:17.653268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:17.653268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 171/348] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:17.653268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.698497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.699638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.700071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.700477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.705672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.722820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:17.738841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:17.739918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:17.740755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:17.743716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 178/349] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:17.744940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.781994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d45bc-8e96-4f12-9990-45f3220479f7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.833771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:17.835163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.836536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.836536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.836536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.849973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:17.851457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:17.853213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 172/350] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:17.854204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.870611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536472a-7235-40a0-a038-7f59cbc81c2e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:17.909954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:17.911300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:17.911783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:17.912256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:17.913824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:17.915587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:17.917558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 179/351] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:17.918638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:17.990161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae96afd-d10f-4d90-83c5-eee0c49d6829 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.002810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.032656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.033737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.034228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.034705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.035659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:18.036179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:18.037838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d542-286e-473f-a6ef-6035c58da00d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:18.044690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae492ab5-1c96-4026-a67e-b36c484b1e29 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.047509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 173/352] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:18.049097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b32c-6dde-40a0-8518-17181a63e9f6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.049629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b32c-6dde-40a0-8518-17181a63e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.050108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b32c-6dde-40a0-8518-17181a63e9f6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.051580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 174/353] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:18.052472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b32c-6dde-40a0-8518-17181a63e9f6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.080319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.090641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.091299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.091575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.091841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.092907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:18.093024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:18.094707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac7222-3753-41be-a5c8-ed8321a50502 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:18.103336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 180/354] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:17 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:18.107595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b5d6-cfb4-4f20-b107-f6d1ea7bd959 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.107721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b5d6-cfb4-4f20-b107-f6d1ea7bd959 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.108120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b5d6-cfb4-4f20-b107-f6d1ea7bd959 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.110337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 181/355] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:18.111714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b5d6-cfb4-4f20-b107-f6d1ea7bd959 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.210138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b32c-6dde-40a0-8518-17181a63e9f6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.260705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.262542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.263028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.263488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.265018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:18.265784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:18.267850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029fe49-659d-4ecc-9e7e-6d6365ef2b8d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:18.268815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b5d6-cfb4-4f20-b107-f6d1ea7bd959 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.277440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 175/356] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:18.279063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b1e6-d79f-4b39-a237-e9ed5153fe0d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.279522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b1e6-d79f-4b39-a237-e9ed5153fe0d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.279978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b1e6-d79f-4b39-a237-e9ed5153fe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.318294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5548b1e6-d79f-4b39-a237-e9ed5153fe0d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:18.319703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5548b1e6-d79f-4b39-a237-e9ed5153fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:18.320570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85107b-dd41-4695-af0f-5f7e4e2677d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.321255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85107b-dd41-4695-af0f-5f7e4e2677d1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.321536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85107b-dd41-4695-af0f-5f7e4e2677d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.321810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85107b-dd41-4695-af0f-5f7e4e2677d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.377262 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.395106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.402200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85107b-dd41-4695-af0f-5f7e4e2677d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:18.403796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85107b-dd41-4695-af0f-5f7e4e2677d1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:18.455530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 176/357] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:18.457202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7332c2-5eb4-4c46-9b99-06aea343d141 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.457844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7332c2-5eb4-4c46-9b99-06aea343d141 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.458320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7332c2-5eb4-4c46-9b99-06aea343d141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.485585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3e7332c2-5eb4-4c46-9b99-06aea343d141 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:18.486720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3e7332c2-5eb4-4c46-9b99-06aea343d141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:18.515094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 182/358] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:18.516879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872160d-5d98-430a-beca-11de99fb8c33 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.517170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872160d-5d98-430a-beca-11de99fb8c33 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.517477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872160d-5d98-430a-beca-11de99fb8c33 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.518973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 183/359] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:18.519543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872160d-5d98-430a-beca-11de99fb8c33 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.577473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 177/360] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:18.579288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477364af-49b9-4612-882c-527ce4688087 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.579580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477364af-49b9-4612-882c-527ce4688087 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.579855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477364af-49b9-4612-882c-527ce4688087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.612745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-477364af-49b9-4612-882c-527ce4688087 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:18.614056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-477364af-49b9-4612-882c-527ce4688087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:18.626809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.634501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872160d-5d98-430a-beca-11de99fb8c33 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.672477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.673344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.673627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.673900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.685258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:18.699286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:18.700180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:18.701032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 184/361] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:18.702402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.703841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 178/362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:18.706641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477364af-49b9-4612-882c-527ce4688087 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.739290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.818399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908e844-1208-470a-b4dd-f4cc12d25415 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.819721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477364af-49b9-4612-882c-527ce4688087 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:18.856200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.857075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.857393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.857666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.858858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:18.859185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:18.860223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:18.860355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:18.860871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:18.861393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:18.862080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 185/363] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:18.862859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.874587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:18.883791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:18.884674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:00:18.885492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:18.887949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 179/364] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:18.888929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:18.893395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:18.990947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519243d-a4cc-449b-9650-2de35df02b42 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.012651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.027033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.027714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.027991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.028265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.029020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:19.029357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.030933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.033143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961a427-9ee3-47c3-a37b-e0b1ddc168da None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.039979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 186/365] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.040629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.070987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.072194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.072660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.073119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.085491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:19.094519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:19.095416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:19.096182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:19.098580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 180/366] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:19.099953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.131958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.149111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bcff-3593-4dcf-a0d3-e7608f866b6b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.184547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.185472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.185777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.185989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.187172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.189134 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.190862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 187/367] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.191638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.209201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26761fb8-6646-4f34-bea6-4acf37b14553 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.245638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.246660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.247127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.247598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.248548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:19.249036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.250835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.260005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 181/368] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.261064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.274178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.315159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5766e68-2c04-4886-9ece-a8923946fb2f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.353815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.355250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.355746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.356213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.379878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642b653-4717-4662-b40a-4a82479b2c8b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.383187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.416031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.416762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.417040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.417343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.418252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:19.418434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.419882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.430672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 182/369] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.431340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.445143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.446661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.541739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.577941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1701-9f8f-43af-8e5e-727f591bac61 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.579044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 188/370] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:19.586063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.627522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.628479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.628919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.629192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.630231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:19.630639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.632106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.638982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 183/371] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.639952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.665782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.727895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6720f-20bd-43e3-a575-4af13052d542 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.771414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d6b7b-2971-40ea-b41d-2db127ecebb1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.791629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.792575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.792792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.793059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] PATH_INFO: `/v3/users/783a43658a76425e9c919bf7cb144b17` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.794409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] RBAC: Authorizing `identity:get_user(user_id=783a43658a76425e9c919bf7cb144b17)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.795866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.800441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 189/372] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/users/783a43658a76425e9c919bf7cb144b17 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.801330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:19.842131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.842824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.843098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.843367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.851916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.925457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.927049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.954342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8012b-5a3a-4e8e-9ced-a2b11a5cca74 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:19.978683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:19.991652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:19.993142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:19.993445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:19.993807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:19.995001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:19.996686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:19.998617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 190/373] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:19.999444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:20.041528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 184/374] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:20.042393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:20.076273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:20.114289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b52ec-90b8-4b89-83ce-7942772f0c3b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:20.152491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155555a-06ae-46c2-b36a-f368293e1660 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:20.164064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:20.164742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.165014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.165311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.166151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] RBAC: Adding query filter params (role.id=95cd352b9b9144ad9f49a86b75b75ec1, user.id=783a43658a76425e9c919bf7cb144b17, scope.system=all) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:20.166457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:20.167894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:20.189880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:20.191077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.191350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.191615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.192867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:20.194952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:20.196773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 185/375] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:20 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:20.201658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:20.211500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 191/376] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 20 09:00:19 2022] GET /identity/v3/role_assignments?user.id=783a43658a76425e9c919bf7cb144b17&scope.system=all&role.id=95cd352b9b9144ad9f49a86b75b75ec1 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:20.217581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:20.323596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d5e3-f30f-4e4e-bc14-daab4064a8e0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:20.326217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:20.368545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:20.369749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.370180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.370586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] PATH_INFO: `/v3/projects/41dd52d259a841e396b3c70a528da3dc` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.372568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] RBAC: Authorizing `identity:get_project(project_id=41dd52d259a841e396b3c70a528da3dc)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:20.374224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:20.376935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 186/377] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:20 2022] GET /identity/v3/projects/41dd52d259a841e396b3c70a528da3dc => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:20.383174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:20.387566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:20.527016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bc38-f049-4836-a4d3-986937fe9b61 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:20.567248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7398-88e7-4857-9a10-edb3040447ba None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:20.571759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:20.572636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.572904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.573171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] PATH_INFO: `/v3/groups/8ab67252fda2471cbfa006c4bbfaf78a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.580448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] RBAC: Authorizing `identity:get_group(group_id=8ab67252fda2471cbfa006c4bbfaf78a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:20.582561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:20.584793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 187/378] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:20 2022] GET /identity/v3/groups/8ab67252fda2471cbfa006c4bbfaf78a => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:20.592668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:20.622945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:20.624134 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.624576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.625057 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.626094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:20.626982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:20.628712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c29455-f24d-406b-ae28-fef5954ade6e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:20.639987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 192/379] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:20 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 260 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:20.653677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:20.723507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a4d59-eabc-40cf-9258-31222793d1e1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:20.762929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:20.763607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.763883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.764239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.765083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] RBAC: Adding query filter params (group.id=8ab67252fda2471cbfa006c4bbfaf78a, role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=41dd52d259a841e396b3c70a528da3dc) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:20.765776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:20.767361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc9799-685d-4d33-9817-9b90ae6eeae1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:20.774241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 188/380] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:20 2022] GET /identity/v3/role_assignments?group.id=8ab67252fda2471cbfa006c4bbfaf78a&scope.project.id=41dd52d259a841e396b3c70a528da3dc&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:20.807956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b695d8-a7ca-46f1-97ea-1d1981712ec8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.808477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b695d8-a7ca-46f1-97ea-1d1981712ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.808915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b695d8-a7ca-46f1-97ea-1d1981712ec8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.810519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 193/381] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:20.816567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:20.816846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:20.817126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:20.838870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:20.840165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:20.927913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 189/382] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:20.970908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b695d8-a7ca-46f1-97ea-1d1981712ec8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.090030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b695d8-a7ca-46f1-97ea-1d1981712ec8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:21.116168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:21.127938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270ce91-ca3d-47f4-8d3f-6fca2faa375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:21.128745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270ce91-ca3d-47f4-8d3f-6fca2faa375e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.129016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270ce91-ca3d-47f4-8d3f-6fca2faa375e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.129318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270ce91-ca3d-47f4-8d3f-6fca2faa375e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.142885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270ce91-ca3d-47f4-8d3f-6fca2faa375e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7270ce91-ca3d-47f4-8d3f-6fca2faa375e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:21.151043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:21.151907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:21.152748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 194/383] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:21.159678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.190285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:21.238800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced9c38-8877-4c39-94b4-a76224c80675 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.239431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced9c38-8877-4c39-94b4-a76224c80675 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.239914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced9c38-8877-4c39-94b4-a76224c80675 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.245944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 195/384] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:21.251305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.251987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.252448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.280845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:21.281965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79346ef-0cc9-4d8b-b843-adb36e8a2c08 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:21.282800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:21.384582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:21.385322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.385577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.385824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.386578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:21.386882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:21.388274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:21.392169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 196/385] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:21.403635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 190/386] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:21.410186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.419891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.590520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c201c1-bdad-4be4-a86e-c42edcbd5628 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:21.593598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:21.597494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a2dc3-4db2-496b-abfe-153f8211a329 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:21.599202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:21.637481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:21.638289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.638567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.638834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.650858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:21.658746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:21.659658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:21.660440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 191/387] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:21.668100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.677686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:21.679619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.680035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.680466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.681854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:21.683471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:21.685311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 197/388] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:21 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:21.694269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.849359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dad8a-9e42-408f-9a6f-05f21886d274 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:21.890267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65cf0d-e224-45f8-94ff-cfd9df5eadab None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:21.930277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:21.931562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.931976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.932426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.933465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:21.933778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:21.935671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:21.961538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:21.963159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:21.963159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:21.963426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:21.968716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:21.972352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:21.974511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 192/389] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:21.981354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 198/390] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:21 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:21.982717 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:21.983827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:22.009722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:22.057503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:22.133764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3105-0fcb-4399-806c-1e4c5d7d38a7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:22.176847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:22.177794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:22.178066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:22.179732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:22.181464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:22.183180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:22.187410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 193/391] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:21 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:22.193486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:22.208251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462448b1-89b7-4aec-a314-b093afec69cb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:22.300403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:22.309617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c8841-e502-43d7-bc65-90c3efc33996 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:22.313947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9306f4-9620-4c38-897d-8081057e9942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:22.314856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9306f4-9620-4c38-897d-8081057e9942 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:22.315130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9306f4-9620-4c38-897d-8081057e9942 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:22.315398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9306f4-9620-4c38-897d-8081057e9942 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/groups/743ba52ee729429b9f25f7d134f80718/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:22.322510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9306f4-9620-4c38-897d-8081057e9942 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee, group_id=743ba52ee729429b9f25f7d134f80718, role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:22.324126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9306f4-9620-4c38-897d-8081057e9942 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:22.349208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:22.350798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:22.351213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:22.351680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:22.353031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:22.355540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:22.358229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 194/392] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:22 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:22.359698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 199/393] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 20 09:00:21 2022] PUT /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/groups/743ba52ee729429b9f25f7d134f80718/roles/1efc231eee0048ba834a4bd3d88a430c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:00:22.365729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:22.494620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e99a85-9bca-492e-87c1-48987ceb9eab None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:22.538823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426af31-7788-41df-977b-e213a5407ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:22.540159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426af31-7788-41df-977b-e213a5407ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:22.540648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426af31-7788-41df-977b-e213a5407ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:22.541112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426af31-7788-41df-977b-e213a5407ae8 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/groups/743ba52ee729429b9f25f7d134f80718/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:22.545345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426af31-7788-41df-977b-e213a5407ae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee, group_id=743ba52ee729429b9f25f7d134f80718, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:22.547323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426af31-7788-41df-977b-e213a5407ae8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:22.571040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 195/394] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 20 09:00:22 2022] PUT /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee/groups/743ba52ee729429b9f25f7d134f80718/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:22.662581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60e47d-7182-40b2-9007-63410bb15b32 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:22.663533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60e47d-7182-40b2-9007-63410bb15b32 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:22.664125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60e47d-7182-40b2-9007-63410bb15b32 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:22.666086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 200/395] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:22.679507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:22.680130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:22.680853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:22.706441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:22.707993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:22.710511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:22.788063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 196/396] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:22.826693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60e47d-7182-40b2-9007-63410bb15b32 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:22.957288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:22.963206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60e47d-7182-40b2-9007-63410bb15b32 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:23.001628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:23.002499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.002775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.003045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.014197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:23.022959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:23.023896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:23.025386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 201/397] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:23.030251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:23.157683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464059f6-a927-4d48-9e19-46f943a9c577 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:23.205949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:23.206972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.207418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.207852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.208786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:23.209269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:23.210833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:23.216674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:23.222050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 197/398] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:23.227309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:23.362232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accda2f-6767-4d8b-adcd-cc91ead0e9a9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:23.402557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:23.403425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.403697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.403965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.405128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:23.406678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:23.408839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 202/399] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:23 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:23.414304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:23.529327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70475fc8-b652-472b-ac35-958804da6583 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:23.568719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4cf84-2ba6-4be5-81d1-d0fd1392e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:23.569624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cf84-2ba6-4be5-81d1-d0fd1392e135 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.569896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cf84-2ba6-4be5-81d1-d0fd1392e135 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.570161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cf84-2ba6-4be5-81d1-d0fd1392e135 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.573952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4cf84-2ba6-4be5-81d1-d0fd1392e135 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:23.575399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4cf84-2ba6-4be5-81d1-d0fd1392e135 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:23.577122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 198/400] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:23 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:23.583013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:23.593897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3b01-232e-409b-8c88-084d878f8c7d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.594256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3b01-232e-409b-8c88-084d878f8c7d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.594422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3b01-232e-409b-8c88-084d878f8c7d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.598133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 199/401] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:23.601746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.602025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.602294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.628971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:23.629246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:23.630705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:23.710305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:23.717614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 200/402] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:23.724996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114cd91-4f8c-4143-9a8c-f757314838c0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:23.743241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:23.761659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fbe64-4c91-4cde-bf62-b3bc8af0fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:23.762605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbe64-4c91-4cde-bf62-b3bc8af0fa23 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.762876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbe64-4c91-4cde-bf62-b3bc8af0fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.763141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbe64-4c91-4cde-bf62-b3bc8af0fa23 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/groups/743ba52ee729429b9f25f7d134f80718/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.767187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fbe64-4c91-4cde-bf62-b3bc8af0fa23 None admin] RBAC: Authorizing `identity:create_grant(project_id=1626d2f0932e45948d7d0cd109ee66f7, group_id=743ba52ee729429b9f25f7d134f80718, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:23.768682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fbe64-4c91-4cde-bf62-b3bc8af0fa23 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:23.787120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 203/403] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 20 09:00:23 2022] PUT /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/groups/743ba52ee729429b9f25f7d134f80718/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:23.790063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901371-686d-4535-bd3e-7957c7344101 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.790356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901371-686d-4535-bd3e-7957c7344101 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.790632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901371-686d-4535-bd3e-7957c7344101 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.797374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 204/404] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:23.802850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:23.803200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:23.803405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:23.840055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:23.842185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:23.931460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9098d8c-8083-474c-98c2-44e14f1d28f9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:23.969085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 205/405] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:23.993258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:23.996767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.001713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.002311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.002664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.012509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:24.019872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:24.028629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:24.029556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:24.030336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:24.036475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 201/406] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:24.037636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.133584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:24.134007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797088c7-213a-4e42-9175-f41b9e5fff8f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.169699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.170502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.170779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.171048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.186045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:24.195601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:24.196546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:24.197369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:24.197990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 206/407] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:24.204611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.255297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8fbe6-ff6c-417d-b1c7-27fc1763b180 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.290791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:24.321013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5b96a-4f13-4074-9826-aad91eeea211 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.354506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.355548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.355830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.356106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.356867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:24.357195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:24.358586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:24.360534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.361509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.361984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.362450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.363408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:24.363932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:24.365517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:24.375191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 207/408] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:24.380739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 202/409] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:24.386540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.386684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.495579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23307-16dd-485d-922d-c98350957a0a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.533435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.534744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.535273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.535843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.537433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:24.539104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:24.540944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 208/410] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:24 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:24.551256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.564581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:24.580879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e585-6c16-4b45-8350-8dad3909756b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.625058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:24.657986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.659199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.659646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.660058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] PATH_INFO: `/v3/groups/8ab67252fda2471cbfa006c4bbfaf78a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.663188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] RBAC: Authorizing `identity:get_group(group_id=8ab67252fda2471cbfa006c4bbfaf78a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:24.664794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:24.668755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 203/411] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:24 2022] GET /identity/v3/groups/8ab67252fda2471cbfa006c4bbfaf78a => generated 229 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:24.675825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.751741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020b5c5-77c7-4be8-a416-f6925ab9f198 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.791867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.793569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.794000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.794578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.796444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:24.798113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:24.801030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 209/412] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:24 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:24.807062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:24.905625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:24.926131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c980f4d-20cf-4fd0-948d-ffbe346d0373 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.936495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9f80-d578-4b3d-b614-e77c7e394506 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:24.976466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:24.978293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:24.978817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:24.979339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] PATH_INFO: `/v3/projects/41dd52d259a841e396b3c70a528da3dc` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:24.981108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] RBAC: Authorizing `identity:get_project(project_id=41dd52d259a841e396b3c70a528da3dc)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:24.983008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:24.985876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 204/413] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:24 2022] GET /identity/v3/projects/41dd52d259a841e396b3c70a528da3dc => generated 344 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:24.991743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:25.026924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd694-11d2-4a8a-8ebb-52a578b8108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.027816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd694-11d2-4a8a-8ebb-52a578b8108a None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.028087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd694-11d2-4a8a-8ebb-52a578b8108a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.028352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd694-11d2-4a8a-8ebb-52a578b8108a None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/groups/743ba52ee729429b9f25f7d134f80718/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.038045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd694-11d2-4a8a-8ebb-52a578b8108a None admin] RBAC: Authorizing `identity:create_grant(project_id=1626d2f0932e45948d7d0cd109ee66f7, group_id=743ba52ee729429b9f25f7d134f80718, role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:25.039820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd694-11d2-4a8a-8ebb-52a578b8108a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:25.057446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 210/414] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 20 09:00:24 2022] PUT /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7/groups/743ba52ee729429b9f25f7d134f80718/roles/1efc231eee0048ba834a4bd3d88a430c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:25.065349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3eed3-f2ff-4c7e-84c4-ca01261292fd None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.065349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3eed3-f2ff-4c7e-84c4-ca01261292fd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.065349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3eed3-f2ff-4c7e-84c4-ca01261292fd None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.065349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 211/415] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:25.068233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:25.071197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.071734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.072348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.096244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:25.097662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:25.172838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452faf4-d577-4fd2-94cc-961801f9e9cf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:25.200375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 212/416] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:25.229345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da46622-4f61-4294-b4a1-3ceac9c41a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.230689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da46622-4f61-4294-b4a1-3ceac9c41a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.230971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da46622-4f61-4294-b4a1-3ceac9c41a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.231231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da46622-4f61-4294-b4a1-3ceac9c41a05 None admin] PATH_INFO: `/v3/projects/41dd52d259a841e396b3c70a528da3dc/groups/8ab67252fda2471cbfa006c4bbfaf78a/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.234246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:25.241752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da46622-4f61-4294-b4a1-3ceac9c41a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=41dd52d259a841e396b3c70a528da3dc, group_id=8ab67252fda2471cbfa006c4bbfaf78a, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:25.243672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da46622-4f61-4294-b4a1-3ceac9c41a05 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:25.261181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 205/417] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 20 09:00:24 2022] PUT /identity/v3/projects/41dd52d259a841e396b3c70a528da3dc/groups/8ab67252fda2471cbfa006c4bbfaf78a/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:25.316013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:25.360228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572c2b7-b65b-40fe-80e4-dbc50ea9828e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:25.380881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79ae00-7f1a-4eb8-982d-3cc7ec5bd5f2 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.381254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79ae00-7f1a-4eb8-982d-3cc7ec5bd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.381472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79ae00-7f1a-4eb8-982d-3cc7ec5bd5f2 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.383026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 206/418] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:25.388702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.390834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.391318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.404825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.406006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.406542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.407240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.420440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:25.430301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:25.431337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:25.432131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:25.434303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:25.435131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 213/419] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:25.435642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:25.442294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:25.531152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 207/420] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:25.556466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:25.587728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794ff9b-ac02-4b4e-a3b8-8b9fcb1c5fb7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:25.621284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:25.623363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:25.649331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.651024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.651306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.651577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.652333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:25.652634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:25.654037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:25.673077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 214/421] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:25.682291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:25.707321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a09b3-90a1-453f-8c1d-e5240a7a1dd8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:25.774424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.775621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.776886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.778176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.799405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:25.809680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:25.810720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:25.811686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:25.814290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 208/422] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:25.820116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:25.888110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bbb40-cac0-43f4-8680-aec34742ef5b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:25.932567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1d44-336f-44fd-8193-d521895452c1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:25.941060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:25.970659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c05ac-536a-41e9-a7e8-31ce0e512d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.971327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c05ac-536a-41e9-a7e8-31ce0e512d36 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.971605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c05ac-536a-41e9-a7e8-31ce0e512d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.971878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c05ac-536a-41e9-a7e8-31ce0e512d36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.974016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:25.974887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:25.975297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:25.975698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:25.976595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:25.977041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:25.978756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:25.989192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 209/423] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:25.995414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.102358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be55df-979b-4560-8bc4-e9f36e427443 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.123110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.136856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c05ac-536a-41e9-a7e8-31ce0e512d36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.138319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c05ac-536a-41e9-a7e8-31ce0e512d36 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.152397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb350f8-be85-497e-9541-af78bfd63a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.153445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb350f8-be85-497e-9541-af78bfd63a3b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.153912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb350f8-be85-497e-9541-af78bfd63a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.154368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb350f8-be85-497e-9541-af78bfd63a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.219959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.243720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 215/424] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:26.245084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f6b90-3cb0-4484-bd60-01d093514078 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.245570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f6b90-3cb0-4484-bd60-01d093514078 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.245674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f6b90-3cb0-4484-bd60-01d093514078 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.247158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 216/425] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:26.248777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f6b90-3cb0-4484-bd60-01d093514078 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.256187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb350f8-be85-497e-9541-af78bfd63a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.257703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb350f8-be85-497e-9541-af78bfd63a3b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.368805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.385484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f6b90-3cb0-4484-bd60-01d093514078 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.388950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 210/426] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:00:26.397126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.397642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.398371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.419934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:26.421409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:26.434734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.436113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.436528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.437185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.439081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.441154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.443861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 217/427] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:26.444780 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.490622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.498122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 211/428] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:26.499084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.572863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a59d9-5868-4e2e-ad18-53e413367cc7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.610773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9097e5-9289-4ac3-8d06-77373cff9c67 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.618121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.619192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.620098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.620511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] PATH_INFO: `/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.622353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] RBAC: Authorizing `identity:get_project(project_id=1f75f5fd95d6496f8b6e1c4396fd0dee)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.624511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.631747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 218/429] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/projects/1f75f5fd95d6496f8b6e1c4396fd0dee => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:26.631747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.654382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.655356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.655735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.656130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.657992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.659604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.661820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 212/430] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:26.662980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.664330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.738490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.775530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7745375-7099-4770-9f69-5ed68eae07a7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.779475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35df2-c6f5-4709-9602-c747d86fe190 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.819578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.820471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.820708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.820974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.822434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.822665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.823652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.823893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.824198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.824620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.830635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 213/431] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:26.830635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.844379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:26.855757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:26.856731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:00:26.858040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:26.858992 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 219/432] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:26.862010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:26.941752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb465-d157-47ea-bce8-e940c3054170 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.956644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.977576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:26.978266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:26.978540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:26.978812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:26.979638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:26.980249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:26.980627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a999a-4475-4821-84ef-ae28dba782e2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:26.981702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:26.983513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:26.989701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 214/433] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:26.991598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:27.023148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.024265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.024737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.025254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.026482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:27.027157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:27.028889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:27.037166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 220/434] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1f75f5fd95d6496f8b6e1c4396fd0dee&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:27.108256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee7afd-bd7c-4c2a-adcb-8f6716050f81 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:27.147622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.148309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.148589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.148849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.149641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:27.149945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:27.151328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb8328-00b2-4978-a97f-3ee7b5ce2562 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:27.164002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 215/435] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:00:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:27.167345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:27.324252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b447ac-2fc8-410b-a54f-db0ced430c80 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:27.361552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.362212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.362489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.362754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.379176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:27.440186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:27.441690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:27.477638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244c33c-bbdd-42b7-a086-1d2269b5d900 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.477965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244c33c-bbdd-42b7-a086-1d2269b5d900 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.478236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244c33c-bbdd-42b7-a086-1d2269b5d900 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.481111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 216/436] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:27.486814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.487098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.487422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.507117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:27.508947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:27.555797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 221/437] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:27.561707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:27.582474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:27.596251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 217/438] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:27.621337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:27.621695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:27.692652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa7892-62de-4476-83b2-89ce15347c59 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:27.750027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.751493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.751773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.752045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.753374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768d92e-8c54-4b99-b365-55d8a8e915af None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:27.753795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:27.754805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:27.761282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 222/439] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:27 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:27.762605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:27.793397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100bc51-6ae6-4cdf-82f9-ee8e7da9865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.794240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100bc51-6ae6-4cdf-82f9-ee8e7da9865b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.794500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100bc51-6ae6-4cdf-82f9-ee8e7da9865b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.794771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100bc51-6ae6-4cdf-82f9-ee8e7da9865b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.806744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100bc51-6ae6-4cdf-82f9-ee8e7da9865b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7100bc51-6ae6-4cdf-82f9-ee8e7da9865b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:27.816314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:27.817204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:27.818046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 218/440] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:27.819170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676f82-58c4-4d28-9f40-832ffe2cbc41 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.819170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676f82-58c4-4d28-9f40-832ffe2cbc41 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.819328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676f82-58c4-4d28-9f40-832ffe2cbc41 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.820704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 219/441] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:27.825364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3676f82-58c4-4d28-9f40-832ffe2cbc41 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:27.871585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611fbc2-29a5-4390-b216-1e6c7e1d2699 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:27.879331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:27.886409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:27.906443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8aacc-1899-40a0-9de9-e2640f1c02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.907473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8aacc-1899-40a0-9de9-e2640f1c02d3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.907744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8aacc-1899-40a0-9de9-e2640f1c02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.908005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8aacc-1899-40a0-9de9-e2640f1c02d3 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.909176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8aacc-1899-40a0-9de9-e2640f1c02d3 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:27.910648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8aacc-1899-40a0-9de9-e2640f1c02d3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:27.912325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 223/442] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:27 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:27.913462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.913737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.913977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.930331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:27.931101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3676f82-58c4-4d28-9f40-832ffe2cbc41 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:27.931529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:27.965356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:27.966013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:27.966308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:27.966544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:27.967282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:27.967611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:27.969297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:27.978541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 220/443] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:27.979428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.008131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 224/444] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:28.009735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.079942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63236fd-ff21-47ba-aacd-6fd5f5e1219b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.092459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.112702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec417bb7-3c05-4565-a3ff-227ba0a1ff6f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.115476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.116136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.116413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.116681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.117550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=550e64942da9455c93c07ee3fa124eb6, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:28.117852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.119297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.125290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 221/445] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:27 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=550e64942da9455c93c07ee3fa124eb6 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:28.125573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.125997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.154128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.154807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.155082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.155349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.233664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.235804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.246016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169955e4-6169-48f5-8693-030cf1b7751a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.284416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.285259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.285532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.285797 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.297364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:28.305825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:28.306738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:28.308024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 222/446] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:28.313684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.356507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.362058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 225/447] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:28.367809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.383142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.436236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ba3cd-a874-4b27-b4dc-62b90224c09f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.476527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.477298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.477593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.477865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.478614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:28.478915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.480630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.481455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419907-cfc9-415a-b7df-d5465ce38eed None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.490816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 223/448] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:28.496438 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.519279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.520150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.520425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.520693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] PATH_INFO: `/v3/projects/1626d2f0932e45948d7d0cd109ee66f7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.521912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] RBAC: Authorizing `identity:get_project(project_id=1626d2f0932e45948d7d0cd109ee66f7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.523382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.525099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 226/449] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/projects/1626d2f0932e45948d7d0cd109ee66f7 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:28.530568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.596821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.601333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d07c-84a1-410f-a897-1d28932ac632 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.613729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.635268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442f96-0063-452d-9dcd-f4dea39c36bf None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.638248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.638907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.639190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.639465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.670336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.671293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.671637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.672052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] PATH_INFO: `/v3/groups/743ba52ee729429b9f25f7d134f80718` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.673474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] RBAC: Authorizing `identity:get_group(group_id=743ba52ee729429b9f25f7d134f80718)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.674927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.676538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 227/450] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/groups/743ba52ee729429b9f25f7d134f80718 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:28.682245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.707896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.709401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.784096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59668-ce3a-4fd7-b927-d7e1791a4eb0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.806590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:28.816377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 224/451] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:00:28.817669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:28.818339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.819008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.819288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.819533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.820409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] RBAC: Adding query filter params (group.id=743ba52ee729429b9f25f7d134f80718, role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=1626d2f0932e45948d7d0cd109ee66f7) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:28.820712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.822174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.828854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 228/452] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/role_assignments?group.id=743ba52ee729429b9f25f7d134f80718&scope.project.id=1626d2f0932e45948d7d0cd109ee66f7&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:28.927883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780f3b9-2e26-46e3-a819-e155b960ab06 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:28.970820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:28.971701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:28.971953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:28.972228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] PATH_INFO: `/v3/projects/41dd52d259a841e396b3c70a528da3dc` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:28.973607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] RBAC: Authorizing `identity:get_project(project_id=41dd52d259a841e396b3c70a528da3dc)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:28.975089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:28.976813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 225/453] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/projects/41dd52d259a841e396b3c70a528da3dc => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:28.983166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:29.000625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:29.098731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90aef-599d-4be0-a598-a15c7ffd0c65 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:29.133581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6165d41-3c3c-4695-bbfb-2399950dcf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:29.134418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6165d41-3c3c-4695-bbfb-2399950dcf35 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:29.134701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6165d41-3c3c-4695-bbfb-2399950dcf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:29.134972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6165d41-3c3c-4695-bbfb-2399950dcf35 None admin] PATH_INFO: `/v3/groups/8ab67252fda2471cbfa006c4bbfaf78a` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:29.136216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6165d41-3c3c-4695-bbfb-2399950dcf35 None admin] RBAC: Authorizing `identity:get_group(group_id=8ab67252fda2471cbfa006c4bbfaf78a)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:29.137725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6165d41-3c3c-4695-bbfb-2399950dcf35 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:29.139365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 229/454] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 20 09:00:28 2022] GET /identity/v3/groups/8ab67252fda2471cbfa006c4bbfaf78a => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:29.146242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:29.213556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:29.247729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b081a-28b7-423f-bbc9-713bd6735c46 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:29.283166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:29.283831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:29.284107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:29.284378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:29.285209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] RBAC: Adding query filter params (group.id=8ab67252fda2471cbfa006c4bbfaf78a, role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=41dd52d259a841e396b3c70a528da3dc) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:29.285559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:29.287021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e1b4-0d32-497b-b30b-125cf02ea41c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:29.292960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 226/455] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 20 09:00:29 2022] GET /identity/v3/role_assignments?group.id=8ab67252fda2471cbfa006c4bbfaf78a&scope.project.id=41dd52d259a841e396b3c70a528da3dc&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:31.783368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0077-90e6-400c-926a-a7968be817ca None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:31.783368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0077-90e6-400c-926a-a7968be817ca None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:31.783368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0077-90e6-400c-926a-a7968be817ca None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:31.784570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 230/456] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:31.788613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:31.789013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:31.789194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:31.813453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:31.814643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:31.901913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2e33d-4bbc-42ef-862f-f2cb3090a7e8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:31.902233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2e33d-4bbc-42ef-862f-f2cb3090a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:31.902481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2e33d-4bbc-42ef-862f-f2cb3090a7e8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:31.904039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 231/457] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:31.909435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:31.909717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:31.909989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:31.917040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 227/458] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:31.938426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:31.939626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:31.942290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.025678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:32.055723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 232/459] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:32.082950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.096771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:32.105525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573b2c7-f29a-46b4-a687-35ab9332dc19 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.164292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.165526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.166108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.166670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.179816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.181615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:32.210860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:32.211766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:32.212604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:32.212604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:32.212604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:32.212604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:32.215072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 228/460] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:32.220719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.274339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5481a-2cc6-49e6-9faf-f89e14906796 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.311638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.312774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.313339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.313818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.325188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.326956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.342577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542e778-ef4e-43a8-b586-b1598e0aec30 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7fbb511c-5ee8-461b-bf07-6db1310be7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:32.347398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:32.348221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:32.349033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:32.349033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:32.349033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:32.349033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:32.351347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 233/461] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:32.352976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec208c3-1548-4026-b3ea-c0853528dc59 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.353587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec208c3-1548-4026-b3ea-c0853528dc59 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.354070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec208c3-1548-4026-b3ea-c0853528dc59 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.356607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:32.357500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 234/462] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:32.358497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec208c3-1548-4026-b3ea-c0853528dc59 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.382534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.383201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.383511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.383754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.384484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:32.384830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.386381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27660-d4a3-4a93-9223-b6d8962835c0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.403782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 229/463] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:32.403782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.403782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.403782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.419596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:32.420787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:32.453416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:32.498214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec208c3-1548-4026-b3ea-c0853528dc59 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.509405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 230/464] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:32.509405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.546462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.547498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.547787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.548065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.548794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:32.549137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.550625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb5ec-2886-4d88-98e5-7cbcf9929e8f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.569343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 235/465] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:32.570581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12180-05a5-4c6c-a0d6-c488df73b2d1 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.570896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12180-05a5-4c6c-a0d6-c488df73b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.571142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12180-05a5-4c6c-a0d6-c488df73b2d1 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.576490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 236/466] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:32.577102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12180-05a5-4c6c-a0d6-c488df73b2d1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.616077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dd968-54ed-45fd-9f72-a9e01a60b7c3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.617720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:32.651969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.652640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.652915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.653189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.653918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.655366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.685633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 231/467] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:32 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:32.686860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.691464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12180-05a5-4c6c-a0d6-c488df73b2d1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.720132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:32.736086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.737812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.738338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.738976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.752503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.754581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-5c040e19-d2da-4016-b9ba-52e60f68aaac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:32.776254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:32.777181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:32.778037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:32.778037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:32.778037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:32.778037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:32.780194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 237/468] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:32.781942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.782440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.782848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.803504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:32.805561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:32.839693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d322b-df19-4d26-a662-91cb3ba21ebb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:32.881465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:32.882049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:32.882339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:32.882594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:32.883301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:32.889462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 238/469] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:32.889462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.889649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:32.915827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 232/470] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:32 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:32.917207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:32.941686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:33.033029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef220-d36d-42ed-a2eb-3cf38d7ee197 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:33.036916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:33.069427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07027-9a5a-4adb-ad51-8592aff99f02 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:33.076675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:33.077376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.077658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.077985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.079303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:33.079622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:33.081127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:33.096721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 239/471] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:33.103736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:33.118888 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:33.120066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.120594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.121055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.132898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:33.134771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:33.153933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:33.154845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:33.155687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:33.155687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:33.155687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:33.155687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:33.161362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 233/472] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:33.164540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:33.218754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a69bcb-a5d0-431c-bae0-a4cdfc2e3395 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:33.239547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:33.258880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:33.259562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.259842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.260114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.260823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:33.262299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:33.285960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919f9df-e40f-45aa-9e22-37a3693ad4f6 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:33.289753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 240/473] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:33 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:00:33.324643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:33.325757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.326266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.326749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.327767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:33.328304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:33.330303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab522f-9ed5-4df7-a04d-7bad2b89b150 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:33.349770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 234/474] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:33.351733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:33.378805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:33.488813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390496ef-91b8-401c-84bc-98d12f3c6fc5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:33.528824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:33.529543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.529825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.530101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.530835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:33.532288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:33.535229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211da8-185f-439c-b127-dab64b568fc7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.535515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211da8-185f-439c-b127-dab64b568fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.535790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211da8-185f-439c-b127-dab64b568fc7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.537443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 235/475] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:33.543723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.543967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.544236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.558428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 241/476] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:33 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:33.567704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:33.568956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:33.653380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 236/477] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:33.679112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:33.771729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:33.796818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181804-8ef1-4398-8ee8-962a3370397d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:33.834586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:33.835362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:33.835548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:33.835822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:33.836610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:33.838063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:33.845639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.sql.core [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 09:00:33.845639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 09:00:33.845639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [parameters: {'id': '9e1c369199c742b393ceb035702a8f21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 09:00:33.845639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80405) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result.read() Jul 20 09:00:33.863469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:00:33.864392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application yield resource Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise self.value Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application session.commit() Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 09:00:33.865290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.session.flush() Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application compat.raise_( Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 09:00:33.866118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:00:33.866991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result.read() Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:00:33.867800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [parameters: {'id': '9e1c369199c742b393ceb035702a8f21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:33.868559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 09:00:33.869367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:33.870194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 242/478] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 20 09:00:33 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:33.877870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:33.940606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:33.988890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f7d4-f798-4174-ae94-e252f1134167 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:34.032057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475030e3-2c26-4b39-a8ca-4bb7dbe3ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:34.033069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475030e3-2c26-4b39-a8ca-4bb7dbe3ba6c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:34.033437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475030e3-2c26-4b39-a8ca-4bb7dbe3ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:34.033714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475030e3-2c26-4b39-a8ca-4bb7dbe3ba6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:34.047622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475030e3-2c26-4b39-a8ca-4bb7dbe3ba6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-475030e3-2c26-4b39-a8ca-4bb7dbe3ba6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:34.055980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:34.056870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:34.057692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 237/479] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:00:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:34.063165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:34.176777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b1935-4fb8-4a50-9447-562a3d64ea1c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:34.210933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:34.211532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:34.211897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:34.212180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:34.212934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:34.213256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:34.214646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ac2d4-560d-4bd7-8956-b473fa0276c0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:34.223617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 243/480] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:35.210342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b39d-b08c-4273-a5b8-7f7fdfad9093 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.211363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b39d-b08c-4273-a5b8-7f7fdfad9093 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.211873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b39d-b08c-4273-a5b8-7f7fdfad9093 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.213816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 238/481] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:35.218957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.219794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.220274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.228376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:35.243730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:35.245269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:35.344713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 244/482] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:35.390781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b39d-b08c-4273-a5b8-7f7fdfad9093 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:35.517621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b39d-b08c-4273-a5b8-7f7fdfad9093 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:35.539344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:35.557175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:35.558004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.558284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.558556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.569273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:35.577123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:35.578061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:35.578846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:35.579582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 239/483] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:35.586029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:35.741893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bc704-1aa8-4ee3-9e5f-0638f4e2600e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:35.782110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:35.790768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:35.791691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.792168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.792797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.793752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:35.794229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:35.795784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8738ec-ceba-48f6-85c5-acfe6bcea223 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:35.808674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 245/484] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:35.814734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:35.816272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb6db-2347-47f4-8aca-51bdea478d85 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.816555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb6db-2347-47f4-8aca-51bdea478d85 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.816824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb6db-2347-47f4-8aca-51bdea478d85 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.818842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 246/485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:35.824336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1023d47-177b-4f1d-84e4-e8a19e481457 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.824617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1023d47-177b-4f1d-84e4-e8a19e481457 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.824892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1023d47-177b-4f1d-84e4-e8a19e481457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.849964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e1023d47-177b-4f1d-84e4-e8a19e481457 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:35.851216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e1023d47-177b-4f1d-84e4-e8a19e481457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:35.973069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9e21-266a-48bd-8850-57c21d7c15ec None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:35.988624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 247/486] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:35.990104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d8bd6-9385-49fb-8d5d-c9d1165a8799 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.990391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d8bd6-9385-49fb-8d5d-c9d1165a8799 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.990666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d8bd6-9385-49fb-8d5d-c9d1165a8799 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:35.992082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 248/487] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:35.997580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:35.997864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:35.998143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.022021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:36.026392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:36.033969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.034718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.034996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.035267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.048065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.049629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:36.069123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:36.070054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:36.073560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:36.073560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:36.073560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:36.073560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:36.073560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 240/488] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:36.073560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.115491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.120974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 249/489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:36.126331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.204684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.212322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c364a-0207-4533-ad99-481af7c2016f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.249150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.250417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.250900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.251398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.262255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd637-9eaf-4d73-82ed-5d1df2859817 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.262941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:36.271036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:36.271939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:36.272716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:36.275440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 241/490] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:36.276447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.308314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.309420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.309965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.310447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.311423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:36.311926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.313718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.326374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 250/491] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:36.327526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.393715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.406861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412b84-0d82-4ad9-8d44-40ce770a7034 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.436327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb82a4-bc1a-4592-b8ac-79ccfdb7c33a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.442476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.443296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.443571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.443959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.450646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.458723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:36.466653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:36.467518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:36.468375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 242/492] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:36.469007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.477504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.478492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.478743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.479473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:36.480114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.481538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd832b09-f95c-4a74-8425-ff8f8cda8d2e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.490211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 251/493] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:36.491514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e835-fb38-41e8-a4ab-63da42a46402 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.491798 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e835-fb38-41e8-a4ab-63da42a46402 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.492072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e835-fb38-41e8-a4ab-63da42a46402 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.497329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 252/494] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:36.497329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8e835-fb38-41e8-a4ab-63da42a46402 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.589873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f19a-6c35-4526-9e3b-d7e1493ae6df None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.603618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8e835-fb38-41e8-a4ab-63da42a46402 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.632523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.633350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.633629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.633899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.639840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.640680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.640961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.641243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.642014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:36.642316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.642409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.643696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.643871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.656672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 253/495] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:36.656672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e617a856-c630-43e0-a10d-afafcf9b5f83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:36.659661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:36.660537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:36.661461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 243/496] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:36.663314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.663314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.663314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.679668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:36.680876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:36.683091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.704987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.754115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 244/497] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:36.755353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.773776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451178a7-5584-4374-b4be-6cef28050851 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.815009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.816079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.816364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.816639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.828412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.829947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:36.851720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:36.852688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:36.853680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:36.853680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:36.853680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:36.853680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:36.853680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 254/498] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:36.854023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.879095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dde89-beef-4efa-95aa-b42046c8a283 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:36.918600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:36.919906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:36.920484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:36.921219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:36.929127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.934470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:36.936404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:36.954142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:36.955066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:36.956109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:36.957133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:36.957133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:36.957133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:36.957133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:36.961382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 245/499] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:36.962271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:36.968515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f927-ed1b-4f72-90ad-510128df08b0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.005937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.006626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.006901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.007173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.008029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:37.008336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.009799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.051277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 255/500] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:37.051277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.069351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bff69c-b38f-49fa-8957-8ac7f820d039 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.104596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.105789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.106065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.106331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.116997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:37.124836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:37.126141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 246/501] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:37.132156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.150903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857127e-bc65-4e3c-b6eb-e3ec3e923f93 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.183159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.185659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.186310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.186589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.186852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.187748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:37.188096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.189529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0591cb-0a4e-457b-a80d-59bdb838e6d3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.201073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 256/502] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:37.203132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6ad3-76b8-43a1-9dfa-41218ff40b0d None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.203409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6ad3-76b8-43a1-9dfa-41218ff40b0d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.203681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6ad3-76b8-43a1-9dfa-41218ff40b0d None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.205904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 257/503] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:37.209483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c6ad3-76b8-43a1-9dfa-41218ff40b0d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.217729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.237777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06edba9-02bf-443c-a1c8-85da0e7e1251 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.270326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.270993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.271268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.271538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.272254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:37.272550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.273964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.285758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 247/504] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:37.286753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.315944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c6ad3-76b8-43a1-9dfa-41218ff40b0d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.350988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ded01-4d11-4570-a1af-8fdaa2d2975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.351918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ded01-4d11-4570-a1af-8fdaa2d2975c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.352198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ded01-4d11-4570-a1af-8fdaa2d2975c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.352752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ded01-4d11-4570-a1af-8fdaa2d2975c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.395673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb0380-ae4c-44d3-a5c1-a2c06fcb103b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.406443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.419208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ded01-4d11-4570-a1af-8fdaa2d2975c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.420683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ded01-4d11-4570-a1af-8fdaa2d2975c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.429662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.430317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.430423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.430593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.430868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.431610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:37.431897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.433451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.441823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 248/505] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:37.442645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.531746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 258/506] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:37.532838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.533110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.533427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.549208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:37.550439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:37.551302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f4193-76a9-445f-b423-f1e82fdd89e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.584277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.585053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.585373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.585626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.593161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.595137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:37.610088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:37.611061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:37.611962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 249/507] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:37.612546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.619769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 259/508] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:37.620642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.643523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.669185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.711613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537069-766a-48f6-9f03-6d388967b8e1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.730365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081379da-a9c1-4e6b-806a-366c53b089bf None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.746146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.746952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.747203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.747478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.755450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.756946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.764063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.764867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.765202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.765655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:37.771663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:37.772555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 250/509] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:37.774205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.779374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.781337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:37.799911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:37.800926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:37.802326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:37.802326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:37.802326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:37.802326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:37.802326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 260/510] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:37.802326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.871256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.881020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819abc8f-8db9-4531-960d-287f396e48fc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.899055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:37.908633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf6b2e-5f10-459e-89b6-7bc9f067cac2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:37.914602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.915395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.916075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.916346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.928249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.929828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.942566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:37.943234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:37.943511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:37.943778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:37.944620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:37.944926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:37.946448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:37.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:37.947709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:37.948689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:37.948689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:37.948689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:37.948689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:37.948689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 251/511] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:37.949073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:37.965946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 261/512] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:37.966795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.048921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3f2d-6b4c-497c-8a36-cb15600740ae None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.069095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f1c55-f7b3-40cf-9bc7-5b24ab425dd9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.082615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.083538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.083813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.084082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.094609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.096067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.098547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.103306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.104075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.104417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.105060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.105914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:38.106220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.107651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:38.115337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:38.116355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:38.117201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:38.117201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:38.117201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:38.117201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:38.117201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 252/513] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:38.117507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.129851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 262/514] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 20 09:00:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:38.130716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.140808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.222203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d115e-7b29-43cc-b792-09e40cb2c720 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.234409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56a23f-b271-4ec1-9845-1c7ff51100d9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.259375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.260153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.260430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.260696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.261462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:38.261765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.263169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.270218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.270911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.271177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.271457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.272184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:38.272490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.273887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.274984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 253/515] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:38.275890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.286586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 263/516] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:38.287414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.343166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.360924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.396012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45134-3d78-4967-b3f8-d3ff5263f46c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.396231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074dbf9-368f-4dd8-8f00-be8da84c2eec None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.431183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.431754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.431863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.432123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.432392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.432491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.432688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.432955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.433110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:38.433437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.434826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.446255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 264/517] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:38.447094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.503282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.504676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.544255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcd233-3f99-444f-b506-29dffc0723f9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.559099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.569553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.579960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.580649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.580922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.581191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.603606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 254/518] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:38.604443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.648221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.649751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.704070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05614a2-d95c-4dea-8870-37dca5b31c1e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.738649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.739444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.739720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.739985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.747304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.748775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.750037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 265/519] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:38.750880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:38.763977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:38.764844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:38.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 255/520] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:38.766466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.783146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.786206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:38.856408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1522-f593-42af-9819-1da83860ee22 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.874219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654555e-a759-4c23-ab8c-489e42bc5a32 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:38.890728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.891703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.892015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.892260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.899048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.900481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.908595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097725c-f220-4c48-b72b-603744455fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:38.909288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097725c-f220-4c48-b72b-603744455fad None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:38.909568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097725c-f220-4c48-b72b-603744455fad None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:38.909837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097725c-f220-4c48-b72b-603744455fad None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:38.910551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097725c-f220-4c48-b72b-603744455fad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:38.912051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097725c-f220-4c48-b72b-603744455fad None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:38.914914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:38.915698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:38.916525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 266/521] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:38.916986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:38.932963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 256/522] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:38 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:38.933790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097725c-f220-4c48-b72b-603744455fad None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.015579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.018978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.037434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb7742-4578-4108-be9b-1a4d4e36e3a1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.055768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097725c-f220-4c48-b72b-603744455fad None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.078441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.079403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.079681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.079956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.092760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.094819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.098566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.099489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.099862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.100224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.111930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:39.113252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:39.114224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:39.115274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:39.115274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:39.115274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:39.115274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:39.115699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.115787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 267/523] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:39.115787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:39.131743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:39.132651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:39.133531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:39.133531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:39.133531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:39.133531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:39.134180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 257/524] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:39.134858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.225629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f30af-1386-4236-8da2-38db40213cec None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.242420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff9cc6-2589-4c17-a19e-239148e806dd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.260757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.261574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.261848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.262025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.262864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:39.263164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.264622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.271882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.274772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.289367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.289593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 268/525] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:39.289676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.289745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.289813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.289813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.289813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:39.289813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.289813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.307651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 258/526] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:39.308531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.404073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76eec-cf6e-42ae-9de8-24351d992804 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.411737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0691964-ad6b-4f58-9a64-b1fe44a3f21c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.444186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.445269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.445610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.445885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.446613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:39.446917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.448297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.449661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.450333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.450613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.450893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.451626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:39.451927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.453395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.461311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 269/527] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:39.462092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.474600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 259/528] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:39.474600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.523358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.526844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.574024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48aed-348b-4a54-a1cf-7ec6f335ff55 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.580987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d853-566c-4cfa-b1ba-b72cffbf443a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.612685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.613424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.613718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.614007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.618101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.618992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.619443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.619886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.620895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=3e99c32d943148cd8625c3ebd6c11887) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:39.621414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.623203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.630602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 260/529] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/role_assignments?user.id=3e99c32d943148cd8625c3ebd6c11887&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:39.631856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.691399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.693040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.760766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.780263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e56ea-9cd0-4b5d-b872-d738dafaa89d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:39.797140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:39.816700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 270/530] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:39.818096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.837623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:39.839048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:39.839758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:39.840210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:39.851725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:39.853924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:39.878506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:39.879426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:39.880298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:39.882748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 261/531] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:39.887627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:39.952498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a3091-8856-4558-9daa-a7bd9823daf1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.000483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ea8d-375c-42fe-be90-6c01ffbe1351 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.003935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.004977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.005464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.005917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.015555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.018464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.038409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:40.038895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:40.039718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:40.040546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:40.040960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.040960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.040960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.043223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 271/532] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:40.044372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.057534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.059201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.068613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:40.080496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:40.081650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:40.082712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:40.082712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:40.082712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:40.082712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:40.088970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 262/533] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:40.090176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.121809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:40.168822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f23f-5068-4d93-8df5-0a3d6f389ef4 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.207725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.208538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.208915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.209325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.210215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:40.210643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.212183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.233038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed48d07-8d0b-4a95-bb1d-62c47584c838 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.233709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 272/534] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:40.234837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.269123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.269820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.270095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.270387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.271559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:40.271866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.273343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.285607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 263/535] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:40.286648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.326529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:40.351512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a2fe-142c-4efb-ab51-8e4914a52fc2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.387077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:40.387902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.388830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.389416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.389943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.391460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:40.392026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.392993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf90e9d-c7b4-41a1-9c76-8f1b4c4634ed None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.393969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.411675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 273/536] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:40.413372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.428853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.429645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.429929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.430189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.431317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=f2d3b8154d784b779c87717947789ace) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:40.431425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.432856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.439335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 264/537] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/role_assignments?user.id=f2d3b8154d784b779c87717947789ace&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:40.440158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.525632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb840-6746-4e08-a6db-a5cf40123e57 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.551339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fbbb5-416a-4f69-b4d0-da942fff2569 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.563872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.564929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.565428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.565909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.567230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=264ac709e4744acdaf774ab52c165862) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:40.567770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.569477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.572765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:40.581371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 274/538] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/role_assignments?user.id=264ac709e4744acdaf774ab52c165862&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:40.594006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.595172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.595600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.596004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.605343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.607248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:40.623481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:40.624679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:40.625722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:40.628053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 265/539] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:40.634208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.803028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d848c1-3692-440a-8e72-6ae877ff0775 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:40.838754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:40.839680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:40.840107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:40.840509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:40.841467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:40.841906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:40.843516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b4161-3c21-4eac-ac26-0bbc1086439c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:40.865920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 275/540] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:40.874615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:40.881618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:40.992000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d16c-f04a-4e88-b43d-93ddbfc97cfe None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:41.032994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:41.033750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:41.034032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:41.034307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:41.035192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=31629ab2ee4a43a290db0875f619fdb3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:41.035491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:41.036976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1342c1-d837-4508-b8dc-b6c2fc2c6a9d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:41.047902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 266/541] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:40 2022] GET /identity/v3/role_assignments?user.id=31629ab2ee4a43a290db0875f619fdb3&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:41.181403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9f134-ca7e-4293-8f68-d2d19c972959 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:41.181715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9f134-ca7e-4293-8f68-d2d19c972959 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:41.181884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9f134-ca7e-4293-8f68-d2d19c972959 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:41.183644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 276/542] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:41.195460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:41.195790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:41.196005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:41.222292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:41.223511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:41.320714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:41.327123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 267/543] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:41.350969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9f134-ca7e-4293-8f68-d2d19c972959 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:41.454404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:41.499329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9f134-ca7e-4293-8f68-d2d19c972959 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:41.535147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:41.535950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:41.536229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:41.536502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:41.547534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:41.555420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:41.556299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:41.557088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:41.561334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 277/544] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:41.563135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:41.684691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca795dd-0724-4265-a5ff-563fa0b9f61d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:41.719764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:41.720362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:41.720642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:41.720973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:41.721787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:41.722137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:41.723550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:41.736458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 268/545] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:41.742144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:41.855117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54dc0-049b-4f73-aa8a-3b03f9de7122 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:41.885881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:41.891210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:41.892313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:41.892646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:41.893069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:41.904585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:41.906184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-04c70b24-37f8-4278-be65-f26f1c41260f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:41.924722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:41.925658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:41.926495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:41.926495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:41.926495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:41.926495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:41.926495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 278/546] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:41.934686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.008474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:42.044153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b1548-2f2d-43b0-b06e-7943304e1351 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.044594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b1548-2f2d-43b0-b06e-7943304e1351 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.044702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b1548-2f2d-43b0-b06e-7943304e1351 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.049328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 279/547] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:00:42.066989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.067306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.067537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.069488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a072eb3-3973-4909-ae23-461ce88db2ab None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:42.102460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:42.103740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:42.111094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:42.112169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.112675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.113185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.114174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:42.114703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:42.116327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:42.130755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 269/548] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:42.135861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.226483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 280/549] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:42.251055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.356872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdca2b2-b52c-4815-97e3-bc85fc369216 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:42.391929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799da52-2d90-4d7d-b796-945809d0f37b None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:42.393495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:42.401281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:42.418760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:42.419594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.419874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.420148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.429860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:42.429860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:42.445316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:42.446939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:00:42.448208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:42.449472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 270/550] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:42.455171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.460959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:42.461805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.462088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.462360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.484167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:42.498330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:42.499243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:42.500505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:42.504119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 281/551] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:42.509653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.632181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce6375-2352-4c0e-8de5-a7d8cfe98c51 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:42.633876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451df42-b434-47c0-89b2-44f4e686b61a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:42.669801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:42.670473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.670755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.671029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.672050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:42.672364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:42.673799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:42.683965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 282/552] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:42.690101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.703797 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:42.704773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.705198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.705636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.708480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:42.708950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:42.710612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:42.744010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:42.774872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 271/553] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:42.782235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.834032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31ffa-152a-4e3c-bebf-d27b98fe636b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:42.869515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:42.896215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:42.896931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:42.897210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:42.897498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:42.918051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:42.919503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:42.947790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:42.948697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:42.949593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:42.949593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:42.949593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:42.949593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:42.949593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 283/554] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:42.956725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:42.989403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be65cf3-d074-44d0-84b6-dea20848bef4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.034622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b67f5-2753-4273-88e6-141f2d39c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.035321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b67f5-2753-4273-88e6-141f2d39c011 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.035603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b67f5-2753-4273-88e6-141f2d39c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.035877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b67f5-2753-4273-88e6-141f2d39c011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.113753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.135762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b67f5-2753-4273-88e6-141f2d39c011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.137300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b67f5-2753-4273-88e6-141f2d39c011 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.141009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa6dc-dd44-4320-8ed1-515199dbd3eb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.177419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.177776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.178514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.178938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.179407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.180351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:43.180855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.182498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91612a-5ba3-41fd-b4f5-02bb562529cf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.197709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 284/555] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:43.199451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dfbb4-7c12-42d6-9bd6-8763a54301a3 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.199944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dfbb4-7c12-42d6-9bd6-8763a54301a3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.200487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dfbb4-7c12-42d6-9bd6-8763a54301a3 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.202671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 285/556] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:43.203644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dfbb4-7c12-42d6-9bd6-8763a54301a3 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.255263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 272/557] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:43.256663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469597-908d-4216-aa87-4d5d4d218b38 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.256954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469597-908d-4216-aa87-4d5d4d218b38 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.257260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469597-908d-4216-aa87-4d5d4d218b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.275092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3d469597-908d-4216-aa87-4d5d4d218b38 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:43.276419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3d469597-908d-4216-aa87-4d5d4d218b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:43.319769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dfbb4-7c12-42d6-9bd6-8763a54301a3 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.360312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.361110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.361419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.361692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.369468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 273/558] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:43.369468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fccf1-99dc-4a02-b1e5-ded144d2785d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.369468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fccf1-99dc-4a02-b1e5-ded144d2785d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.369468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fccf1-99dc-4a02-b1e5-ded144d2785d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.369468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 274/559] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:43.369468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fccf1-99dc-4a02-b1e5-ded144d2785d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.371980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.379099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.380728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-26cb8a43-20d9-42cf-8531-9d304cbea3c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:43.398316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:43.399523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:43.400474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 286/560] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:43.401075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.401206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.401513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.418893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:43.420106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:43.447721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.483607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fccf1-99dc-4a02-b1e5-ded144d2785d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.488488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 287/561] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:43.489429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.528664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.529850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.530276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.530546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.541630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.543095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:43.561535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:43.562661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:43.563691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:43.563691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:43.563691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:43.563691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:43.563691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 275/562] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:43.563691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.612729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dccd8d-9b12-4372-8d86-9e55eba37e72 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.643270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.653847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.654674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.654950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.655216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.665817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:43.673718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:43.674627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:43.675503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 288/563] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:43.676160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.682356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3874-92ac-460f-8640-9c6654dc2df4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.704644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.720300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.720973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.721254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.721543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.722379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:43.722682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.724234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.742441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 276/564] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:43.743239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.782826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657f7f4-e849-4e03-acd4-42509f9cde13 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.819379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14764a-fb9c-4c81-b10f-ab95eb47a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.820179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14764a-fb9c-4c81-b10f-ab95eb47a954 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.820460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14764a-fb9c-4c81-b10f-ab95eb47a954 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.820728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14764a-fb9c-4c81-b10f-ab95eb47a954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.831300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14764a-fb9c-4c81-b10f-ab95eb47a954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3c14764a-fb9c-4c81-b10f-ab95eb47a954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:43.839071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:43.840168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:43.841159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 289/565] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:43.842027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058d28-6524-424f-a80b-4b0e5fbf433f None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.842183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058d28-6524-424f-a80b-4b0e5fbf433f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.842475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058d28-6524-424f-a80b-4b0e5fbf433f None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.845354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 290/566] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:43.845354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83058d28-6524-424f-a80b-4b0e5fbf433f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.853880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a623fad-c3ff-4e5c-8ccf-766cb7179f3a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.888408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.889086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.889396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.889669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.890671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:43.890977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.892370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.895759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.904145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 277/567] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:43.904948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:43.944854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:43.950062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83058d28-6524-424f-a80b-4b0e5fbf433f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:43.983675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:43.984482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:43.984758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:43.985025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:43.985822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:43.986100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:43.987479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:43.995864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 291/568] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:43.996672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.004446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4eb3-66bd-4dab-806f-6298694915db None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.039749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.040559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.040863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.041129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.052061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.053563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4562be3a-3bae-4a51-931c-76b0fb21146d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:44.070512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:44.071402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:44.072280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:44.072280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:44.072280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:44.072280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:44.072280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 278/569] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:44.072927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.073142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.073443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.090165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:44.091402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:44.103267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e23d6e-7267-424f-9f94-fbd600a6ef75 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.113563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.138948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.139612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.139887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.140325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.141082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:44.141416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.142810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.150931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 292/570] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:44.151806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.162171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 279/571] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:44.163201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.185334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.253861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02060b8f-cf76-493c-9525-811780b0fb83 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.262666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04cffa-7a77-4ac6-ab3d-1299cb696b0c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.287321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.288124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.288399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.288668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.295473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.297312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.299347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.300154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.300423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.300688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.311472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:44.313297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:44.314343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:44.315448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:44.316066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.316138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 293/572] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:44.316138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:44.336480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:44.337675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:44.343559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:44.343559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:44.343559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:44.343559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:44.343559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 280/573] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:44.343559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.352692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.424627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.426990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dcee-5ca9-49c2-bcaf-528d6ca79626 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.463570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.464283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.464577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.464839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.465056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b45bb-79e5-48c6-9c0f-896bb4ab3741 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.465600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:44.465906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.467291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.479459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 294/574] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:44.480634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.500457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.501446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.501673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.501949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.512649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.514155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:44.532631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:44.533629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:44.534487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:44.534487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:44.534487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:44.534487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:44.538716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 281/575] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:44.539606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.578722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.588886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d217d2-b6f5-4ddf-8e67-98563bde1123 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.632805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.633638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.633952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.634327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.645179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:44.652808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:44.653985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:44.654948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 295/576] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:44.655773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.663234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99424e17-eb22-41c1-bb47-38896844e9ca None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.690184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.701387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.702071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.702349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.702779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.703590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:44.703993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.705472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.717672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 282/577] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:44.718706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.760204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107558c-d256-4012-9a94-ff7c5f709ddd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.795600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.796159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.796604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.796873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.797627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:44.797931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.799329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.812333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 296/578] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:44.813249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.818441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17f33-2034-4a83-8aea-94ee14640f03 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.825116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.853534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.854346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.854955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.855228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.862684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.864130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:44.877776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:44.878822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:44.879884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:44.883901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 283/579] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:44.884482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.916939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824775bb-f3e9-4a00-864c-3da34eea33dd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:44.932325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:44.951857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:44.952671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:44.953022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:44.953550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:44.954353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:44.954732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:44.956127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:44.967336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 297/580] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:44.968192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:44.988754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afcc2d-eab9-4d32-9857-4e6dc28bb820 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.023365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.024037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.024321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.024592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.025375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:45.025683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.027062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.035426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 284/581] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:45.036211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.037457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.069349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec435e4-1723-4c78-a151-8e648fead1ae None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.105714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.106365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.106649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.106920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.107774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=72c1b7dca4f0464c8f63394d348c95ad) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:45.108063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.109671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.115963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 298/582] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:44 2022] GET /identity/v3/role_assignments?user.id=72c1b7dca4f0464c8f63394d348c95ad&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:45.116807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.145279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770037-8141-46e2-81eb-5806b0fdfab9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.153760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.186645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.187745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.188062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.188393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.196824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.198532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:45.217366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:45.218632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:00:45.219861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:45.221643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 285/583] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:45.222411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.254433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3b2a-9d13-4889-91e7-aa78f56df958 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.291888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.292564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.292849 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.293122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.293978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:45.294287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.295919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.297786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.314615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 299/584] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:45.314615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.350353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470606-6549-46bb-8850-9b9e7c3d0e68 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.387596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.388494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.388841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.389175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] PATH_INFO: `/v3/users/glance` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.398804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.400585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:45.416206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:45.417419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:45.418364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 286/585] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:45.418933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.427597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d14c3-5685-4a00-9289-84371031061c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.448555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.467779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.469342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.469771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.470044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.481528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.483030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:45.503440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:45.504428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:45.505322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:45.505322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:45.505322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:45.505322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:45.509450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 300/586] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:45.510344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.532519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3cd1-54ff-4d56-b651-b656ec27e7db None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.559944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.571437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.572115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.572391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.572662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.573533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:45.573842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.575276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.593730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 287/587] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:45.594588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.622813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4d63-bcd2-4b42-b7df-ed6833ad336f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.665324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.666278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.666556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.667097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/3e99c32d943148cd8625c3ebd6c11887/roles/500c93384d994628af0bd2e13816f736` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.686523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=3e99c32d943148cd8625c3ebd6c11887, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.688160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.689103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.703948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 301/588] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:45 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/3e99c32d943148cd8625c3ebd6c11887/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:45.704761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.716392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e05547-8e39-47ca-a09d-1cde2931ff6c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.777911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.779317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.780261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.780945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.782353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:45.783121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.785665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.813381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 288/589] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:45.814895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.829433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:45.840673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78a967-f5fc-42a0-b57b-8394561bd339 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.882971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.883557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.883832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.884100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:45.884832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:45.885136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:45.886560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:45.902274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 302/590] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:45.903189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:45.958110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f57621-5895-4bcc-ba56-1c628e268f1b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:45.995326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:45.996242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:45.996503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:45.996782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.008056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.009543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.011345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.025357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64da62-1a3d-470e-b241-acdc6330355f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:46.029156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:46.030046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:46.031314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:46.031314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:46.031314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:46.031314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:46.031314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 289/591] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:46.032072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.072977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.074181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.074860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.076212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.090747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.093003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:46.116568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:46.117573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:46.118431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:46.118431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:46.118431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:46.118431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:46.120814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 303/592] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:46.122679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.138023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.156831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f9b8c-38e3-451a-a118-ef7eefd8154f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.197297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.198222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.198461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.198735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.207018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.208704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:46.224804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:46.226003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:46.227036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 290/593] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:46.227603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.254139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ae98-01aa-456c-b210-d2ea92021712 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.289803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.295896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.297498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.301262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.301262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.301262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:46.301262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.301262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.317206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 304/594] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:46.318585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.343167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782844cf-4c15-4594-81c8-6966ffbc3fb7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.381217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.381924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.382196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.382461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.383276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:46.383669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.385090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.398205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 291/595] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:46.398962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.402200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.440967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc0afb-07fb-4a0f-a114-8a850420442d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.481107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.481828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.482316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.482604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.483995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:46.484404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.486394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.510678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 305/596] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:46.511532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.528883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6f37-8adf-4d37-8822-f5724d4289a3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.549006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.573913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.575080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.575625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.576173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.586469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.588328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:46.604783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:46.605918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:46.606794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:46.613362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 292/597] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:46.614478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.638154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c5e65-1d6b-407f-9c94-a2b61d2dc501 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.672014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.682515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.683716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.684006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.684279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.694481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.696196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:46.720785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:46.721743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:46.722685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:46.725301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 306/598] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:46.726343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.736148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3bf15-df93-43ad-81d6-d55bcfb1ea54 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.780003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.781119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.781791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.782131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.795431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.797656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:46.820699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:46.821729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:46.822588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:46.822588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:46.822588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:46.822588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:46.822588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 293/599] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:46.822868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.845611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc54a4-a760-4e8f-bc67-e3567cb8e659 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.855230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.884045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.884735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.885011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.885317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.886111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:46.886412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.887958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:46.901699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 307/600] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:46.907494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:46.948881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cff6c5-4068-4f9c-b71e-ea2478ee237c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:46.961684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:46.989815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:46.991412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:46.992006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:46.992704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:46.994172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:46.994731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:46.996464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.010013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 294/601] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:47.011154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.023926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd383-1fb8-4fb8-8bf1-03ac4712ade7 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.070313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.071583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.072555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.073030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.074235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:47.074990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.076941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.094361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 308/602] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:47.096088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.115383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:47.132963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f785d7-03aa-4b2b-9340-d6c75998c016 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.181734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.183272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.183749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.184460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/264ac709e4744acdaf774ab52c165862/roles/500c93384d994628af0bd2e13816f736` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.205053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=264ac709e4744acdaf774ab52c165862, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.207214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.217165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4a26-7372-43bd-b2da-f89f430d2444 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.233258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 295/603] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:47 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/264ac709e4744acdaf774ab52c165862/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:47.233258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.234669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:47.258113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bb644-51a5-4ca2-ab42-43bdb6b2a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.259035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb644-51a5-4ca2-ab42-43bdb6b2a776 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.259314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb644-51a5-4ca2-ab42-43bdb6b2a776 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.259589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb644-51a5-4ca2-ab42-43bdb6b2a776 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/f2d3b8154d784b779c87717947789ace/roles/500c93384d994628af0bd2e13816f736` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.278531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bb644-51a5-4ca2-ab42-43bdb6b2a776 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=f2d3b8154d784b779c87717947789ace, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.280751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bb644-51a5-4ca2-ab42-43bdb6b2a776 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.309409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 309/604] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:47 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/f2d3b8154d784b779c87717947789ace/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:47.311065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04128e4-6fc8-4d8f-8eec-ba0040be5a07 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.311516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04128e4-6fc8-4d8f-8eec-ba0040be5a07 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.312025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04128e4-6fc8-4d8f-8eec-ba0040be5a07 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.317795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 310/605] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:47.321318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.321814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.322262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.350715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:47.355265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:47.430706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b147386-b32e-4fa6-b246-b5dd43fa1566 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.470675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.471754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.472188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.472615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.476729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:47.480699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 311/606] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:47.486254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.487879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:47.503996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:47.504937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:47.505845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 296/607] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:47.513389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.522706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.655440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:47.662036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4dc8d-5b88-41d3-af0c-3c3556277932 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.681252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b807b4-e2bd-4161-9a8e-ab48264d4031 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.722413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.723027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.723301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.723566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.724359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:47.724657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.726151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.733055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.734061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.734456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.734731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.755502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 312/608] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:47.758636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.762235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:47.778517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:47.779641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:47.782385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 297/609] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:47.787102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:47.886251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:47.893846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46d07-2c9c-4f8e-8991-2e2d65f890c8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.937015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d2aa-09d8-47ff-a7d4-0f9d91701e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.937259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c121f3-bd26-420c-a330-7248019866e3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:47.937840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d2aa-09d8-47ff-a7d4-0f9d91701e61 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.938060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d2aa-09d8-47ff-a7d4-0f9d91701e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.938329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d2aa-09d8-47ff-a7d4-0f9d91701e61 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/31629ab2ee4a43a290db0875f619fdb3/roles/500c93384d994628af0bd2e13816f736` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.957759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d2aa-09d8-47ff-a7d4-0f9d91701e61 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=31629ab2ee4a43a290db0875f619fdb3, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.959216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d2aa-09d8-47ff-a7d4-0f9d91701e61 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.963208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:47.976830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:47.977539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.978032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.978316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.979095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:47.979733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:47.980416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 313/610] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:47 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/31629ab2ee4a43a290db0875f619fdb3/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:47.981166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:47.982052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ca66-4d0f-43c8-9028-d78fd727ec63 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.982520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ca66-4d0f-43c8-9028-d78fd727ec63 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.982942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ca66-4d0f-43c8-9028-d78fd727ec63 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:47.984851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 314/611] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:47.990404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:47.991305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:47.991719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.003488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 298/612] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:48.009529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.012391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:48.013989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:48.101613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 315/613] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:48.136613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.231515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8880c-5690-4dbf-8a7e-86adc164f1f4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:48.250436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:48.268075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:48.268881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:48.269160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:48.269463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.270959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccba0a-a020-43d9-a40f-c8264bc63e82 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:48.280751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:48.282566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:48.300190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:48.301087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:48.302253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:48.302253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:48.302253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:48.302253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:48.302253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 299/614] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:48.307026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:48.310193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.358540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:48.359544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:48.359996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:48.360430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.385146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:48.395681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:48.396777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:48.397829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:48.407336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 316/615] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:48.414553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.456196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e383cc6-3fd8-43f8-8926-cdd03fee1913 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:48.521473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:48.522448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:48.523010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:48.524191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.525734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:48.526365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:48.528846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:48.557690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 300/616] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:48.558784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.607755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa94342-c6d3-409a-9c6c-448b6fbd437d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:48.616072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:48.688279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:48.688980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:48.689277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:48.689548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.690325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:48.690623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:48.692039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:48.708676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 317/617] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:48.714534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.740024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d36a-bce9-4df8-ac89-b9c829b5cfc9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:48.782210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:48.783050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:48.785584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:48.785870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.800436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:48.802104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:48.820825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:48.842035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:48.843217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:48.844325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 301/618] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:48.849415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:48.878642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc558-7695-4c47-b4ea-e48c56e204b0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:48.948087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:48.948902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:48.949177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:48.949469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:48.971375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:48.973181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:49.008330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:49.009420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:49.010440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:49.010440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:49.010440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:49.010440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:49.010440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 318/619] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:49.010440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.024918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:49.044858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294faf03-3620-43c4-99a0-621f4d814400 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.113347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.114087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.114369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.114643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.115496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:49.115801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.117324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.136230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 302/620] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 20 09:00:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:49.142158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.177981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298585a4-decc-44c0-9a43-3f55aa4003ac None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.185578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:49.222367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.223030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.224267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.224537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.225282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:49.225588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.226961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.256059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 319/621] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:49.259967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.313455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c40b2-b20c-4b09-9dad-ce630dbda695 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.380556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.381396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.381662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.381926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.406085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.407556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.422689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:49.439537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:49.440467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:49.441347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:49.441347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:49.441347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:49.441347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:49.443024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 303/622] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:49.448761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.455789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fdcbb-fc95-48f6-87ee-d03a502ca081 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.526950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.527748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.528020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.528286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.540802 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.542290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:49.562846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:49.563879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:49.564799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:49.565842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 320/623] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:49.578027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.613258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:49.628756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31bd6-d773-459d-94fa-6b9e7ddcdf8c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.668807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.669914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.670598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.671978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.673212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:49.673762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.676587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc719777-a761-426a-b0e1-f1aef604acbe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.696561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 304/624] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:49.696561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168b0b9-813c-498b-b5da-f84e592ca455 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.696561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168b0b9-813c-498b-b5da-f84e592ca455 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.696561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168b0b9-813c-498b-b5da-f84e592ca455 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.696954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 305/625] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:49.699869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168b0b9-813c-498b-b5da-f84e592ca455 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.721279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581a18-72c9-495d-9339-86caeac3681b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.756345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.757011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.757311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.757579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.758407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:49.758707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.760230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c327d-fb26-4b42-b3bf-8c74e77486fb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.785358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:49.787016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 321/626] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:49.788746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.789108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.789458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.812068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:49.813653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:49.839553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168b0b9-813c-498b-b5da-f84e592ca455 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:49.875787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:49.876580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.876854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.877119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.884152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:49.885815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:49.893574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 322/627] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:49.893574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:49.907577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7ecc091f-23af-4c74-aba4-acc5c75c1fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:49.910554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:49.911675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:49.912853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:49.916907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 306/628] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:49.918593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa483-1db7-4ede-b381-043b8626302d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:49.918873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa483-1db7-4ede-b381-043b8626302d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:49.919148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa483-1db7-4ede-b381-043b8626302d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:49.920479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 307/629] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:49.921286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa483-1db7-4ede-b381-043b8626302d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.004600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8505b-b2bc-4305-bbfe-c8cd2f53159a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.037869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa483-1db7-4ede-b381-043b8626302d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.039649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcbc4e-fa66-4a2c-9fcb-2f92f5df3b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.040311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcbc4e-fa66-4a2c-9fcb-2f92f5df3b67 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.040583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcbc4e-fa66-4a2c-9fcb-2f92f5df3b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.040852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcbc4e-fa66-4a2c-9fcb-2f92f5df3b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.060311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.075506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.076469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.076469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.076744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.077590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:50.077885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.079498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.096949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 308/630] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:50.096949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.113983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcbc4e-fa66-4a2c-9fcb-2f92f5df3b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.115466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcbc4e-fa66-4a2c-9fcb-2f92f5df3b67 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.125161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.201823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ed15-4318-459a-bd03-fb47c8a5c98c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.222963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 323/631] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:50.224601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.224977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.225262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.237186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.238015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.238310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.238564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.242580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:50.243893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:50.248889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:50.256934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:50.258079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 309/632] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:50.258907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.310853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.329967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 324/633] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:50.329967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.373588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.376653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036770-1328-4189-86eb-ce75ba706f58 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.409600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.410499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.410772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.411076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/72c1b7dca4f0464c8f63394d348c95ad/roles/500c93384d994628af0bd2e13816f736` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.425140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=72c1b7dca4f0464c8f63394d348c95ad, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.426678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.430821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15c04b-e1f9-4011-960c-d82eee882bf5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.440313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 310/634] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:00:50 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/72c1b7dca4f0464c8f63394d348c95ad/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:00:50.441114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.494801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.496425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.496707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.497119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.510581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.512127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-43cf62d1-bf11-43e8-8e19-51b1c66a544d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:50.532038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:50.533021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:50.533919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:50.533919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:50.533919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:50.533919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:50.538151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 325/635] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:50.539639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbff24-994e-4d56-b6e1-27767ec06abd None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.539916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbff24-994e-4d56-b6e1-27767ec06abd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.540183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbff24-994e-4d56-b6e1-27767ec06abd None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.545273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 326/636] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:50.545273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbff24-994e-4d56-b6e1-27767ec06abd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.549929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.562353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86deb-218a-497f-aa01-5ad7142c089e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.606744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.607144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.607424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.607694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.608443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:50.608816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.610202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.618706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 311/637] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:50.619517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.650879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.663697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbff24-994e-4d56-b6e1-27767ec06abd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.698352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c66b6-6762-439e-a85f-2d32470603b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.699154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c66b6-6762-439e-a85f-2d32470603b5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.699430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c66b6-6762-439e-a85f-2d32470603b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.699703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c66b6-6762-439e-a85f-2d32470603b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.710096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c66b6-6762-439e-a85f-2d32470603b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-836c66b6-6762-439e-a85f-2d32470603b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:50.717961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:50.718912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:50.719734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 327/638] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:50.720402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.720856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.720954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.734499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8661a-b14a-4c9d-87fa-d676b38a52cc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.738316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:50.740226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:50.770035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.771197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.771495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.771744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.772476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:50.772759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.774145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.790961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 312/639] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:50.790961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.804762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.818318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 328/640] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:50.819217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:50.901098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:50.919251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12ec2e-0daf-4c42-9265-40f650b5d1d2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.924375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822f2f-d809-463f-8236-32d627035e6d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:50.957062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.958038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.958412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.958785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.963402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:50.964164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:50.964444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:50.964709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:50.965474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:50.965774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.967138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.971726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:50.974350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:50.984339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 329/641] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:50.984339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:51.003648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:51.004803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:51.005977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:51.005977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:51.005977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:51.005977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:51.007322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 313/642] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:51.008200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.077251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.096733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48154-3013-4a21-8d07-09fa47fba480 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.118358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3262ff-5030-4f6c-a853-138b3191b33a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.134522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.135544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.135969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.136411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.143973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.145476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.154590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.155329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.155910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.156167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:51.160606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:51.161548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:51.162448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 330/643] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:51.163621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.165792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.173622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:51.181443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:51.182530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:51.184152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:51.187831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 314/644] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:51.188747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.277577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3ceb4-8647-43ba-855a-4a5aa0acf539 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.294294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538387a4-d462-412f-b256-2f2dab9ede35 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.320483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.324507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.325452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.325834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.326214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.337923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.339680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.340103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.340838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.341193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.341569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.342291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:51.342594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.344279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.357221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 315/645] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:51.357646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:51.358877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:51.360208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:51.360208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:51.360208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:51.360208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:51.360208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 331/646] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:51.360208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.361489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.417429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.464772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ea25f-d438-4a16-b770-227a7433557c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.474429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc5d2-b5e9-4a5e-bfc2-e08ac8e7a107 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.500977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.501678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.501960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.502235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.502983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:51.503293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.504752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.513756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 332/647] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:51.514561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.518869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.519543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.519820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.520090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.520914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:51.521206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.522729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.536895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 316/648] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:51.537607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.588209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.637431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3f37-750b-471c-a255-46fb57f56563 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.647063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ece43-16d3-40a0-b8b0-20d8b6800f46 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.658470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.677048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.677775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.678052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.678321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.679048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:51.679350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.680723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.683409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.684402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.684860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.685331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.693003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 333/649] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:51.693854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.697940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.699624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:51.715847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:51.716786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:00:51.718010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:51.719968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 317/650] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:51.720568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.802114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced297-6842-4efe-baad-c3e0bcf3c09e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.825964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e3a8d-7a4c-40d5-8f34-9f0b4e0ae1a7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:51.829589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:51.841489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.842381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.842665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.842994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.855381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.856830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.866257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:51.866974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:51.867311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:51.867638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:51.868517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=3e99c32d943148cd8625c3ebd6c11887) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:51.868883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:51.870405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:51.874816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:51.875863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:51.876765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:51.876765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:51.876765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:51.876765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:51.876765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 334/651] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:51.877272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.889574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 318/652] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/role_assignments?user.id=3e99c32d943148cd8625c3ebd6c11887&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:51.889574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:51.913192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.012869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320494b5-ba4d-4fb9-a986-5e9e83fc4722 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.017753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c2934-33c0-4f2e-a983-bc885e529c75 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.056053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.057069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.057538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.057983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.058986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:52.059462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.061152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.066957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.067763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.068138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.068475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.078216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.080071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.081389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 319/653] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:52.082290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:52.098745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:52.099796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:52.100858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 335/654] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:52.101607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.119907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.212979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e24a5-c1e9-49a8-90af-e430a6ebfc1d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.219898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.241147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82921-c1f7-468a-8338-1b8e5d901529 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.250002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.250668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.250943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.251213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.251972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:52.252313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.253719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.266393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 320/655] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:52.267175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.277980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.278639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.278920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.279289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.352507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.356494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.358367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.370628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb6d6-4fc6-43dc-9f81-623630000d08 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.405221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.406039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.406377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.406716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.407614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:52.407985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.409502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.428235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 321/656] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:52.429172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.458947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.473680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 336/657] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:52.474638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.533431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2bcba-38a8-40d6-b499-90f6cb23864c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.571642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.572612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.572890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.573153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.576860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a936411-96e0-45be-b194-120a1e87d804 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.580814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.582289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:52.597984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:52.599148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:00:52.600325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:52.603831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 322/658] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:52.604973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.609744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.620553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.621206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.621533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.621862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.680763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.697495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.699022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.714535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e61309-cce6-4755-9d4f-7193698588d2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.748029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.748836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.749271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.749548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.760118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.761595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e523418a-da76-45e0-98ea-3cc52b56a373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:52.778964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:52.779895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:52.780992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:52.780992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:52.780992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:52.780992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:52.780992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 323/659] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:52.781779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910194d-7c15-4364-b6ee-d4d506b4c56c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.782055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910194d-7c15-4364-b6ee-d4d506b4c56c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.782325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910194d-7c15-4364-b6ee-d4d506b4c56c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.787618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 324/660] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:52.788329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910194d-7c15-4364-b6ee-d4d506b4c56c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.817738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 337/661] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:52.818657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:52.850007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.898157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910194d-7c15-4364-b6ee-d4d506b4c56c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.912929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:52.926583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b9568-12e6-4e4e-8fb6-37a474fc9636 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:52.934423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.935101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.935381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.935652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.936483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:52.936932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.938585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3535eb-4626-40ad-bc5f-28a8f88f542f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.956446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 325/662] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:52.957591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.957855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.958126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.968658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:52.969344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:52.969617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:52.969887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:52.970611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:52.970926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:52.972297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:52.974971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:52.976154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:52.989589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 338/663] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:52.989589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.063819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 326/664] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:53.063819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.102545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.116156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889206e-4412-418e-9043-9cb9ab850814 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.151502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.152306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.152582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.152854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.159885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f94f5-c7ef-44ae-8949-570dee588ec6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.163768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.165221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.174378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:53.184287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:53.185664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:53.186773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:53.186773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:53.186773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:53.186773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:53.196596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 339/665] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:53.197833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.209712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.210679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.211127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.211562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.285127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.286653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.308131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf16e-f8e7-467e-b029-fcaa3146859e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.338701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.347248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.348038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.348304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.348567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.355898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.357740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:53.372206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:53.373104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:53.374033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 340/666] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:53.374825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.407182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 327/667] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:53.407182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.442548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.486817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67115ea2-229e-45d4-9c9b-573461db2319 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.519957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81f88-d22f-420e-afbd-7bccd9c2b867 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.523830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.524636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.524908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.525177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.535914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:53.543770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:53.544872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:53.545733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 341/668] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:53.546658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.558818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.559695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.559804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.560023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.560750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:53.561050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.563013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.575122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 328/669] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:53.575750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.580476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.658920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e857-bbb5-4e8e-9f49-6ac016a7bf83 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.680096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.684966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc208f-e0ba-4a03-ab26-bb0e71b8abc5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.696841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.697767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.698216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.698630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.699426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:53.699731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.701154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.715464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 342/670] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:53.716206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.725397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.726237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.726513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.726774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.738467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.739980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:53.757271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:53.758213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:53.759095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:53.759095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:53.759095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:53.759095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:53.759095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 329/671] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:53.759386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.819885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.826542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d07369-7e59-48e7-841d-d76af2285e83 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.863403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.864082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.864363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.864630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.866579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:53.866579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.866766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbf718-19f5-4008-abba-52a1103e24a5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:53.868363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.877363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 343/672] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:53.878192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.908304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:53.909466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:53.909680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:53.909953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:53.916937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:53.918413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:53.926334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:53.932917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:53.933826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:53.934710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 330/673] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:53.936031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:53.997759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862c0e-f32b-4562-b0a1-4d38389bcf31 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.032439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.033482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.033934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.034377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.035395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=264ac709e4744acdaf774ab52c165862) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:54.035889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.037640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.044075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 344/674] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/role_assignments?user.id=264ac709e4744acdaf774ab52c165862&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:54.045127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.068925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5fdf6-2023-4c82-bc0d-27c59d0d374a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.095058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:54.118360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.119231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.119775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.119996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.120822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:54.121193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.122737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.137704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 331/675] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:54.138841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.166421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05fe3-26bd-4e2d-b8b6-d10223cb31af None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.174440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:54.205857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.206688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.206964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.207233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.219122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.220457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-64d07b08-efbe-46c0-a2d7-e079417dfe73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:54.241817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:54.242892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:54.243839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:54.243839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:54.243839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:54.243839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:54.243839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 345/676] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:54.244602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63757c8b-532d-48cc-bf19-8a923f47f8b8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.244887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63757c8b-532d-48cc-bf19-8a923f47f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.245165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63757c8b-532d-48cc-bf19-8a923f47f8b8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.246751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 346/677] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:54.247456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63757c8b-532d-48cc-bf19-8a923f47f8b8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.272036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea178-61c1-4114-83f1-e0a0e6299c1e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.314094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.314862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.315254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.315592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.316452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:54.316845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.318402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.335566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 332/678] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:54.335566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.364406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63757c8b-532d-48cc-bf19-8a923f47f8b8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.367312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:54.409678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.410484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.410762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.411033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.418272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.419657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-094c65a4-634d-4a3b-8799-2f16e6a6a396 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:54.434626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:54.435556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:54.436450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 347/679] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:54.437530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.437809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.438006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.453212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f28a-1373-4ff6-84eb-bbc075c2c13f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.455131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:54.456333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:54.470566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:54.489095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.489799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.490075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.490341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.491112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:54.491362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.492741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.514730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 333/680] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:54.514730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.547301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 348/681] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:54.549709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.641326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:54.649352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe232-b392-4521-b877-0feed435e814 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.691502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b186ae-ee1a-4a0a-b1eb-c4549e4dcedd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.697133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.697849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.698124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.698391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.699207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=f2d3b8154d784b779c87717947789ace) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:54.699526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.701383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.708537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 334/682] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/role_assignments?user.id=f2d3b8154d784b779c87717947789ace&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:54.709504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.747729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.750533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.751154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.751662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.753060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:54.754148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.756320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.781215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 349/683] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:54.782548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.797330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:54.870595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e554-ff98-4f57-808e-6617316358d1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.921304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:54.923078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:54.923704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:54.924180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:54.933350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:54.935265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:54.947670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1cb35-ee0a-4551-a457-ec9bf81287bf None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:54.953838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:54.954795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:00:54.955732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:54.958688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 335/684] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:54.959694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:54.988554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:55.009270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.010663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.010961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.011241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.034987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:00:55.045868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:55.047788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:55.049136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 350/685] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:55.051029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.101032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e24dc-4a54-45c9-ba16-ee5fcce3f2bf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:55.141937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.142628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.142909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.143187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.144026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=31629ab2ee4a43a290db0875f619fdb3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:55.144337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:55.146250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:55.147294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:55.155294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 336/686] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:54 2022] GET /identity/v3/role_assignments?user.id=31629ab2ee4a43a290db0875f619fdb3&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:55.156602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.229866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904d4e-0d6d-4783-8782-76cbf98063c4 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:55.330618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:55.337202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.338514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.338859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.339129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.340003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:55.345587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:55.348004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:55.356574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5626a-eb05-47af-8729-5c90886660af None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:55.399314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 351/687] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:55.406744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.410610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.411544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.412010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.412484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.413476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:55.413958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:55.415546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:55.425639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 337/688] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:55.434463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.555725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d90c5-3cd9-4ac0-8773-45a6f65131ea None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:55.586551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4208d6-c93a-48d3-bb20-fd51e9032555 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:55.589317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:55.602405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.603079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.603355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.603763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.624748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.625985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.626462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.626899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.638642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:55.640481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:55.648217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:55.660768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:55.661736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:55.662605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:55.662605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:55.662605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:55.662605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:55.665033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 338/689] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:55.672732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.694522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:55.696010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:55.812306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 352/690] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:55.832126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.877539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc57703-e785-4f0e-8d4e-808da7d42f65 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:55.884360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:55.918299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:55.918980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:55.919258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:55.919535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:55.920267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:55.920570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:55.922146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:55.936038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 339/691] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:55.946320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:55.976852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb6a0-6638-4ecb-9b64-dd802a6c5d17 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.022989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.023793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.024073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.024340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.051423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.052916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.066306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:56.086906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:56.087863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:56.088820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:56.088820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:56.088820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:56.088820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:56.088820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 353/692] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:56.098049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:56.151988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8aad-a19f-4c4b-914c-cb2d59facd94 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.215404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.216213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.216489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.216759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.232721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.234730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:00:56.271513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:56.273713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:00:56.275906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:56.277135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:56.282846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 340/693] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:00:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:56.284405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:56.336061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef297951-4938-4747-af69-f03214ee8f08 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.417696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd955d06-2de0-4efa-b174-6f7da9c4b791 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.422591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.423285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.423566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.423838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.424575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:56.424878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.426351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.451663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:56.456331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 354/694] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:56.456813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.458960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.459512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.459948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.460953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:56.461469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.463308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.464524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:56.498572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 341/695] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:00:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:56.505670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:56.602524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b1fe5-d760-46d5-a87c-6291c048e53a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.644947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e10049-fa88-4400-90c1-ca42908b7daa None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.652228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.653347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.653824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.654282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.663946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.665900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.668203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-250a0fa1-4cbb-459d-bad5-55685dec7086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:56.685096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:56.686222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:56.687551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:56.688440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.689187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.689610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.690001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.690405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 355/696] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:00:56.691876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ee23-d78c-4e0f-86d8-06f36271ddd7 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.692302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ee23-d78c-4e0f-86d8-06f36271ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.692725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ee23-d78c-4e0f-86d8-06f36271ddd7 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.699626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 356/697] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:56.700970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9ee23-d78c-4e0f-86d8-06f36271ddd7 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:56.746351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:56.777617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.779901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.833464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9ee23-d78c-4e0f-86d8-06f36271ddd7 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:56.876351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:56.877270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.877689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.878096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.879045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:56.879488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:56.881577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71931a-4636-43b6-a40a-52561c5c293f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:56.897291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 357/698] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:56.899110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:56.899582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:56.900322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:56.916001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 342/699] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:00:56.917172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:56.926606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:56.928556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:56.996498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.016474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.021315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 358/700] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:57.022499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.068697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed044dc-fec4-4587-847a-1b98f9203dc8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.115433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.116832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.117346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.118864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.119910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=72c1b7dca4f0464c8f63394d348c95ad) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:57.120447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.122166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.132023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 343/701] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:56 2022] GET /identity/v3/role_assignments?user.id=72c1b7dca4f0464c8f63394d348c95ad&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:57.133428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.154993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfc0c-ce52-4338-a6eb-79aa8e607752 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.208837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.209802 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.210148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.210485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.223203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.225000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-d21d23b1-2c81-4eb4-9f4d-36b49f878cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:57.247719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:57.248715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:57.249921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:57.249921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:57.249921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:57.249921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:57.254203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 359/702] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:57.255928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d92d-cd87-4b4a-a344-2f37e62ff3d4 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.256289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d92d-cd87-4b4a-a344-2f37e62ff3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.256647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d92d-cd87-4b4a-a344-2f37e62ff3d4 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.262585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 360/703] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:57.262585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d92d-cd87-4b4a-a344-2f37e62ff3d4 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.289173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e654c41-4ca0-4b67-be07-e9e23b5cceb8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.328500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.340132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.340993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.341314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.341592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.342267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.344214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e42c1e51-cb88-495e-bb5b-dd5b7fefadf6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:57.361021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:57.362286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:57.363212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 344/704] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:57.364309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.364309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.365046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.372436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.386582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:57.388670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:57.410914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d92d-cd87-4b4a-a344-2f37e62ff3d4 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.451244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.451911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.452244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.452521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.453292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:57.453769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.455190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.467864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 361/705] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:57.468715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.474951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 345/706] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:57.476110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.591671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.595260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf8b6-7996-449c-944b-8437de30bae6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.602073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52c9f-b9cb-4fd2-b79a-f0a01132ac87 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.632464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.633131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.633447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.633768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.634501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:57.634796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.636213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.641352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 362/707] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:57.642108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.653639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.654488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.654760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.655029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.657694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.663791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.665727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-27fee9a1-a4cd-410d-9260-0d15c39ff298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:00:57.680515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:57.681677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:57.682604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 346/708] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:57.683134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7291-4855-4885-9fc7-f721667f1f6f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.683427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7291-4855-4885-9fc7-f721667f1f6f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.683702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7291-4855-4885-9fc7-f721667f1f6f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.685122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 347/709] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:57.690160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7291-4855-4885-9fc7-f721667f1f6f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.756646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8163a-2a2e-4f0a-b284-c2ce7fd065e2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.792193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.792995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.793295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.793571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.797263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7291-4855-4885-9fc7-f721667f1f6f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.805798 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.807280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:00:57.825002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:57.825961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:57.826839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:00:57.826839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:00:57.826839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:00:57.826839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:00:57.826839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 363/710] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:57.827170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.841436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.842450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.842924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.843317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.844024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:57.844323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.846290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a11f1-8457-499f-a093-b5cbc9e55cbb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:57.847880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.865328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 348/711] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:57.865328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.865328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.865328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.887105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:57.888750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:57.939903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552651d7-7484-416a-a23b-fe0f4b3bce43 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:57.963175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:57.979540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:57.980397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:57.980772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:57.981142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:57.982084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:57.982485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:57.982900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 349/712] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:00:57.984266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:57.984689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.001255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 364/713] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:58.007312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:58.095051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:58.104058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4904db-2f4e-4d49-9114-cb3e37f5ebaf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:58.122985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b138c-fc39-4d63-baee-87ffbe20b6a2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:58.142007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:58.142683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:58.142962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:58.143231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:58.143960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:58.144259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:58.145675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.158496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 350/714] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:58.163934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:58.177508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:58.178883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:58.179302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:58.179710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:58.181076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=3e99c32d943148cd8625c3ebd6c11887) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:58.181826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:58.183672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.191606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 365/715] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:00:58 2022] GET /identity/v3/role_assignments?user.id=3e99c32d943148cd8625c3ebd6c11887&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:00:58.197907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:58.256408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:58.324461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aeac0-f493-4003-b422-8cb214f3938b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:58.385763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:58.386596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:58.386870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:58.387138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] PATH_INFO: `/v3/services/network` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:58.387798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:58.389194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:00:58.406421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:00:58.407445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:00:58.408247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:00:58.412617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 351/716] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:00:58 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:00:58.413938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:58.441874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd4b-d8e0-41f5-8f90-98ba8bfafe45 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:58.522034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:58.523132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:58.523772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:58.525551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:58.526490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:58.529127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.549561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:58.566782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f843-e46a-4e4f-93c1-797f96921aef None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:58.569027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 366/717] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:00:58 2022] POST /identity/v3/users => generated 254 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:00:58.601646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:58.606574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:58.607589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:58.608227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:58.608704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:58.609668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:58.610390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:58.612112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578814e-af5a-4f46-9b4d-c2773092cab9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.617870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 352/718] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:58.626504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:58.771772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c1f5-ff63-4bfb-8a02-d781cd4a8ddb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:58.813753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:58.814491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:58.814775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:58.815051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:58.815777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] RBAC: Adding query filter params (type=network) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:00:58.816083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:00:58.817501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c11d7-d54b-46bb-9f94-aa9c11662e45 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:00:58.823673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 367/719] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:00:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:00:59.613167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63203e-86fe-47c9-8903-7eb88a741824 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:59.613764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63203e-86fe-47c9-8903-7eb88a741824 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:59.613764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63203e-86fe-47c9-8903-7eb88a741824 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:59.615595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 353/720] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:00:59.625157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:59.625740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:59.625740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:00:59.655584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:00:59.656906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:00:59.748022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:00:59.761614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 368/721] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:00:59.794838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63203e-86fe-47c9-8903-7eb88a741824 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:00:59.945073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63203e-86fe-47c9-8903-7eb88a741824 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:00:59.998290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:00:59.999190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:00:59.999576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:00:59.999846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.014270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:00.022224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:00.023154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:00.024292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 354/722] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:00.029660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:00.204680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ec817-107e-4a7d-af53-4625b42cb604 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:00.260154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:00.260993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.261292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.261614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.262428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:00.262794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:00.264260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:00.278315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 369/723] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:00.284012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:00.358326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:00.434624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e07b-b71e-4898-801c-29ae4e77e1bb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:00.483427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:00.484207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.484567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.484843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.501816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:00.503287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-cd0ed27d-a832-4602-ba5c-db2a570b2dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:00.525476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:00.526452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:00.527835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:00.527835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:00.527835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:00.527835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:00.527835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 355/724] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:00.532943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:00.614745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:00.664890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec659f-3073-4885-b275-a1079934f791 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:00.707918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:00.708504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b12be-f6eb-4345-82a0-6b07f9904322 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.708941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.709027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b12be-f6eb-4345-82a0-6b07f9904322 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.709099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.709199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b12be-f6eb-4345-82a0-6b07f9904322 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.709301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.709848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:00.710156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:00.710853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 356/725] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:00.711557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:00.716269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.716559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.716839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.725196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 370/726] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:00.731058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:00.744425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:00.745621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:00.860609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 357/727] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:01:00.879275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7afd7d-57ae-42bb-b696-a440d87433f1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:00.889549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:00.905725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:00.920580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:00.922029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.922516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.922982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.931482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:00.933631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:00.934654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-9758300e-7e60-470c-b78e-f040631c5e1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:00.950635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:00.951692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:01:00.952674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:00.955100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 371/728] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:00.956608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794154a-44a0-4f7c-b7b4-bb97f70af87d None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:00.957116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794154a-44a0-4f7c-b7b4-bb97f70af87d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:00.957630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794154a-44a0-4f7c-b7b4-bb97f70af87d None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:00.959385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 372/729] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:00.968770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794154a-44a0-4f7c-b7b4-bb97f70af87d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.042489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89afd1-73e0-46c0-9bda-ba44c3f249d0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:01.082666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450cae-99de-4d7f-b0c2-d5f78f9bb503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:01.083779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450cae-99de-4d7f-b0c2-d5f78f9bb503 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.084248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450cae-99de-4d7f-b0c2-d5f78f9bb503 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.084743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450cae-99de-4d7f-b0c2-d5f78f9bb503 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.085672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450cae-99de-4d7f-b0c2-d5f78f9bb503 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:01.087477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450cae-99de-4d7f-b0c2-d5f78f9bb503 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:01.094010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794154a-44a0-4f7c-b7b4-bb97f70af87d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:01.111589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 358/730] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:00 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:01:01.113650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f815f6-456a-4429-8cf6-f8243ac25a1b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.114194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f815f6-456a-4429-8cf6-f8243ac25a1b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.114725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f815f6-456a-4429-8cf6-f8243ac25a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.137367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b5f815f6-456a-4429-8cf6-f8243ac25a1b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:01.139134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b5f815f6-456a-4429-8cf6-f8243ac25a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:01.150692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:01.151761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.152692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.153167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.154707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:01.155493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:01.158406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:01.186628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 373/731] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 20 09:01:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:01.194377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.228247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:01.321305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb858b-b871-45b0-9a5f-507f10fed6a9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:01.361128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891d88c-70be-4560-aa52-36187bd660fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:01.362963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891d88c-70be-4560-aa52-36187bd660fe None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.363799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891d88c-70be-4560-aa52-36187bd660fe None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.364359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891d88c-70be-4560-aa52-36187bd660fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.388921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 359/732] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:01:01.390460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6a725-d196-441c-a14d-20cc46876246 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.390854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6a725-d196-441c-a14d-20cc46876246 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.391125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6a725-d196-441c-a14d-20cc46876246 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.396540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 360/733] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:01.399316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.399815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.400585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.423608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:01.425143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:01.435943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:01.459110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891d88c-70be-4560-aa52-36187bd660fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:01.460595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891d88c-70be-4560-aa52-36187bd660fe None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:01.505365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 361/734] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:01:01.506445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.608856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:01.626119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f48d0-296d-487b-bd9d-5f801f16ddf1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:01.661690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:01.662497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.662772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.663043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.670549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:01.675635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:01.683130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 374/735] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:01.686329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:01.687543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:01.688378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:01.688997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98e2d-baab-47c2-b855-863204776c3e None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.689066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 362/736] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:01.689131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98e2d-baab-47c2-b855-863204776c3e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.689131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98e2d-baab-47c2-b855-863204776c3e None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.689805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.694143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 375/737] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:01.694143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98e2d-baab-47c2-b855-863204776c3e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.804907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15ce8-44bd-42af-a0f7-7ee5c30cf697 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:01.806235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98e2d-baab-47c2-b855-863204776c3e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:01.837465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:01.841092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:01.841970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.842251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.842597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.847659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:01.848445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.848715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.848982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.853661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:01.860307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:01.861770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:01.862332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:01.863306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:01.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 363/738] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:01:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:01.864852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-47d58756-0468-48c6-96dc-34a95ec02f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:01.884877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:01.886022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:01.886876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:01.886876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:01.886876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:01.886876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:01.886876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 376/739] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:01.887594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:01.887868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:01.888135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:01.904885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:01.906301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:01.930396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:01.975627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 377/740] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:01:01.976398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:01.985029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d8892-699c-4e6a-a0cb-7fcfaf5f48dd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.031050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.031932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.032202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.032476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.033214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:02.033541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.034944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.049034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 364/741] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:02.049034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.093573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002f42-b43a-4114-9983-85f498e368c8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.103336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.131402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.132009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.132298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.132558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.133701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:02.134005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.135738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.149113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 378/742] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:01:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:02.149113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.156423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed107df-7783-4d72-91bc-186850764276 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.181548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.197054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.197747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.198060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.198594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.199040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:02.199339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.200700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.218391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 365/743] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:02.218391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.259555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328078d-a8b6-4f22-af18-007adec8711c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.297351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.298077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.298357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.298631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.299920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.304445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.320449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 379/744] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:02 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:02.321210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.338802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1e3c-2557-4b60-85e2-fe135261dc3b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.366249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.391237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.392547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.393039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.393565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.413256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.413256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:02.429213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:02.430192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:02.431067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:02.431067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:02.431067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:02.431067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:02.431067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 366/745] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:02.431822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.469441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78354ff-f5a2-4d9c-89ce-2763e799f2a5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.471818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.529995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.531251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.531778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.532203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.543853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.545438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:02.564268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:02.565208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:02.566131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:02.566131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:02.566131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:02.566131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:02.566131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 380/746] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:02.569345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.569483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5607e-be98-4631-adef-a94891b42353 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.619667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.620950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.621365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.621974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.632216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.634213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:02.655706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:02.656642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:02.657632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:02.664058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 367/747] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:02.664058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.667379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.687846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110058-bb6c-40db-bac8-64921629cc00 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.723561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.724344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.724714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.725055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.725878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:02.726250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.727703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.741155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 381/748] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:02.742015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.792110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.805445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05885e-7d39-4b7a-86b3-6446e2151f84 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.842378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.843310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.843603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.843884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.844606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:02.844909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.846402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.863332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 368/749] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:02.864376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.867007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977f24-7783-42fc-b6e9-18445b2e71ae None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:02.911054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:02.911641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:02.911920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:02.912195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:02.913037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:02.913419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:02.914960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:02.933156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 382/750] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:02.934081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:02.936946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:02.983457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef8903-2df5-4279-bcf3-9b7d27debe45 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.021407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.022322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.022669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.023013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.032096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.033791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:03.049087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:03.050102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:03.051240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:03.051780 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757358-24c2-489c-8885-e4f44bb1ed59 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.051870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 369/751] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:03.051952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.064575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.088545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.089724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.090184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.090595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.099479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.101346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:03.127434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:03.128658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:03.129929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:03.132436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 383/752] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:01:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:03.133383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.174846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838a11d-1424-4dda-8060-8e52e5d76768 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.201813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.212517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.213712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.213712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.214174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.215232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=72c1b7dca4f0464c8f63394d348c95ad) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:03.215654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.217198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.229831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 370/753] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/role_assignments?user.id=72c1b7dca4f0464c8f63394d348c95ad&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:03.231263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.247817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e736-fce1-4f57-b1fa-2960ec3e092a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.290525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.291639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.292159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.292631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.293754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:03.294332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.296127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.317760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 384/754] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:03.324601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.369682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.405600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5bf6-bf81-4dbb-93ef-143ce1c5ab14 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.444286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.444911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.445191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.445497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.446344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:03.446648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.448268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdbdf9-c74f-45de-a93f-68dab6bb4d7f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.473011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 371/755] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:03.475746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109d3d-467b-43af-a4d2-e46c20e1820b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.478913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb2ad-5a1d-418a-95df-513e8f2f4e02 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.479550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb2ad-5a1d-418a-95df-513e8f2f4e02 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.479830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb2ad-5a1d-418a-95df-513e8f2f4e02 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.485274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 372/756] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:03.485274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb2ad-5a1d-418a-95df-513e8f2f4e02 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.505493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.523492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.524634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.525082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.525544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.537149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.538887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-e1baf8d0-86cb-4329-85b1-9996e5cbf7df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:03.558524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:03.559468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:03.560423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:03.560423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:03.560423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:03.560423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:03.563121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 385/757] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:03.564607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.565054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.565512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.584126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:03.585728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:03.594370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb2ad-5a1d-418a-95df-513e8f2f4e02 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.628889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.634272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.635347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.635970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.636485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.673509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 386/758] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:03.674790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.715940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.715940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.800233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5461-0d73-4503-bd6c-5416173e4c1c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.802797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.824607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 373/759] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:03.826054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.845547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:03.846390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:03.846793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:03.847215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:03.848056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:03.848467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:03.849977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:03.865314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:03.866577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 387/760] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:03.867637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:03.960787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b27c-7cb3-4355-9b73-a9017fe0a87c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:03.980693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f121b-d4ea-4594-9172-127926e2778d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.008688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.009918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.010575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.010985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.012446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.014271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.019855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.020826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.021197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.021595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:04.030151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:04.031295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:01:04.032328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:04.040631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.040631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.041038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 374/761] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:04.042120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:04.060094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:04.061282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:04.062596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:04.062596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:04.062596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:04.062596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:04.068830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 388/762] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:04.069749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.087755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.171641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.181436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03dfa-e856-46d0-9b83-714d23c09e32 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.182496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaa1e5-b9fd-476d-9791-1d691edaf773 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.223153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.224087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.224466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.224838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.225691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:04.226094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.227794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.238429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 389/763] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:04.238429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.239492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.241529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.241949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.242356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.251872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.253817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:04.274083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:04.275103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:04.275989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:04.278974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 375/764] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:04.279924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.339718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.372606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a317-de56-40b4-a230-0f061309420d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.416092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.416866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.417337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.417506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.418199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:04.418556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.419873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.429171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61006-7713-4524-b21f-3bb26dab4373 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.434984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 390/765] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:04.435836 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.472093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.472785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.473065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.473370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.474270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:04.474583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.476006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.482588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 376/766] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:04.483534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.504002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.547751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6576a-3b34-4c2e-bb07-b999da188d81 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.583201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.584028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.584301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.584881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.585980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:04.586288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.588339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.590429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada377f-82ab-4e1e-821a-21d9747694aa None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.596687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.604916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 391/767] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:04.605766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.628198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.629063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.629381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.629636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.636720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.638232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-822bf44a-f8e9-4b13-990a-d9a6234c44d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:04.652485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:04.653582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:04.654787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 377/768] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:04.655375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ada0-179a-4732-9877-4a11996eccf0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.655375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ada0-179a-4732-9877-4a11996eccf0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.655598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ada0-179a-4732-9877-4a11996eccf0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.661743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 378/769] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:04.661743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ada0-179a-4732-9877-4a11996eccf0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.721127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f494c07-93de-44de-9f3d-3e71e9e56d0f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.748779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.757679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.758292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.758570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.758950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.759752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] RBAC: Adding query filter params (interface=public, service_id=932235c96aeb46b385245a163bb80f1a, region_id=RegionOne) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:04.760059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.761477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.771778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ada0-179a-4732-9877-4a11996eccf0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.774757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 392/770] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/endpoints?service_id=932235c96aeb46b385245a163bb80f1a&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:04.775623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.808203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342e4df-c6b0-4ca5-870a-b8be5cea1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.809094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342e4df-c6b0-4ca5-870a-b8be5cea1a4c None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.809398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342e4df-c6b0-4ca5-870a-b8be5cea1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.809679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342e4df-c6b0-4ca5-870a-b8be5cea1a4c None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/3e99c32d943148cd8625c3ebd6c11887/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.811882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342e4df-c6b0-4ca5-870a-b8be5cea1a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=3e99c32d943148cd8625c3ebd6c11887, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.813396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342e4df-c6b0-4ca5-870a-b8be5cea1a4c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.828690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 379/771] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:04 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/3e99c32d943148cd8625c3ebd6c11887/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:01:04.830054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.830347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.830621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.856306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:04.857594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:04.863418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:04.921241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf3dc-a8c0-49c9-ac8a-9e6b001921a0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:04.960012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:04.960714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:04.961003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:04.961265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:04.962127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:04.962436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:04.963962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:04.966591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 380/772] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:04.967858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:04.992903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 393/773] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:04.999545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:05.052654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:05.104978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7ff1-8b03-41b6-9525-923fb318ef2c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:05.129775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3cd3-f765-4c5f-90a7-6afac270050b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:05.148747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:05.150194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.150453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.150914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.151832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:05.153395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:05.159457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 381/774] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:05.160276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:05.162319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:05.186348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:05.187670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.188169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.188643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.189834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=36ab6b3da705454cb7369a68d1dd0f7b) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:05.192756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:05.194633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5030a70-5fdf-4c1c-a4eb-f55ea6abb2cd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:05.203062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 394/775] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:04 2022] GET /identity/v3/role_assignments?user.id=36ab6b3da705454cb7369a68d1dd0f7b&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:05.376948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a62e0-0ee4-4d1e-87e0-d050e5ab3b22 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:05.414540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:05.420194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:05.421360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.421605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.421880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] PATH_INFO: `/v3/services/network` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.422575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:05.423974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:05.436916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeadd7-1388-4a45-88ab-1e5cdc685ceb None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:05.437106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:05.438157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:05.439005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 382/776] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:05 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:05.441494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeadd7-1388-4a45-88ab-1e5cdc685ceb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.441947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeadd7-1388-4a45-88ab-1e5cdc685ceb None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.449153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 395/777] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:05.450189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:05.455696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.455977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.456252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.496002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:05.498251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:05.617786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48e6c4-27b8-4825-b047-6982a41eda68 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:05.649805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 396/778] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:05.657517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:05.658404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.658784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.659177 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.659987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] RBAC: Adding query filter params (name=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:05.660388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:05.661955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:05.667149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 383/779] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:05.672612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:05.684632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:05.784898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:05.852267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c6203-5b1d-46a9-b767-f5a3c06ebce4 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:05.870697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:05.891123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be057-9303-4886-b430-8289ae7344aa None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:05.895610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:05.896282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.896557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.896827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.897559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] RBAC: Adding query filter params (type=network) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:05.897867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:05.899246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:05.913634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 397/780] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:05.919464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:05.954167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:05.954978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:05.955251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:05.955522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:05.976102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:05.992501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:05.993514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:05.994346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 384/781] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:06.000046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:06.038580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f992-01d3-4d5c-b194-55ebf38bdbcf None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:06.093777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:06.094652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:06.095031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:06.095397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:06.096298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] RBAC: Adding query filter params (interface=public, service_id=e580f2b68e8e463184fecc9950e9b70c, region_id=RegionOne) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:06.096724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:06.106717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:06.120564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 398/782] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:05 2022] GET /identity/v3/endpoints?service_id=e580f2b68e8e463184fecc9950e9b70c&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:06.126892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:06.148558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca473-bf07-445b-a0cd-c49afa0e02a0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:06.172622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:06.195579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:06.196261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:06.196536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:06.196805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:06.197581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:06.197882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:06.199317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:06.214118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 385/783] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:06.222240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:06.238267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:06.325881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b0180-f63c-409d-8c0f-4432ce17e725 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:06.362396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:06.363071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:06.363345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:06.363614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:06.364354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:06.365758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:06.371500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 399/784] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:06 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:06.379754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac6c0a-d5e9-4315-a845-9a17e45714a0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:06.417523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:06.418340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:06.418621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:06.418886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:06.430599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:06.432000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:06.450629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:06.451856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:06.452995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:06.452995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:06.452995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:06.452995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:06.452995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 386/785] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:06.457940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:06.618895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd04ff7-4f46-4e52-9ed4-95feb8a52ee8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:06.630725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:06.663645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:06.664308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:06.664581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:06.664847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:06.665619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:06.665919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:06.667269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:06.688190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 400/786] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:06.694267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:06.745843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:06.817828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ea99-244d-4fd7-be9c-1a21254e6808 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:06.853288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:06.854461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:06.854740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:06.855012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:06.863343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:06.864944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:06.880239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:06.881200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:06.882197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 387/787] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:06.890358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:07.037631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c3ac-bc65-4a00-8eac-a266f71a4636 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:07.091418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:07.092452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.092940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.093448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.094508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:07.095007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:07.096650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:07.122379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 401/788] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 20 09:01:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:07.127987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:07.329947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:07.337280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f844be-58f9-4c2c-9f2a-10ddb98a8993 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:07.394347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:07.395359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.395638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.395910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.409740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:07.411220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a0981ea8-00f8-4074-83a2-9697c6fb116c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:07.429515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:07.430442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:07.431414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:07.431414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:07.431414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:07.431414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:07.431414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 388/789] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:07.442359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:07.459129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2ad4-7238-4fa6-a706-369f5784e0e7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.459454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2ad4-7238-4fa6-a706-369f5784e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.459686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2ad4-7238-4fa6-a706-369f5784e0e7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.461382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 389/790] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:07.466468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.466744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.467021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.499921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:07.502317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:07.504510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:07.621451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 390/791] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:07.638297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590d51e-cdd8-47a8-83a9-fa2c5f68002d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:07.648866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:07.675687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:07.676617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.676994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.677501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.678245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:07.678656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:07.680324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a466f-d7fe-4e7f-a9a3-86e83402dde5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:07.693582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 402/792] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:07.694912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1628af-0fd5-450d-a5de-483cdb01d670 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.695306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1628af-0fd5-450d-a5de-483cdb01d670 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.695724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1628af-0fd5-450d-a5de-483cdb01d670 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.701462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 403/793] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:07.702411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1628af-0fd5-450d-a5de-483cdb01d670 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:07.736150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:07.761049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007c7e0-b840-49ad-aaad-93ad5a02ffb9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:07.796677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:07.797014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af837283-e390-4f54-b5ef-8292b915fc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:07.797862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837283-e390-4f54-b5ef-8292b915fc3f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.798140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837283-e390-4f54-b5ef-8292b915fc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.798484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837283-e390-4f54-b5ef-8292b915fc3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.809108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af837283-e390-4f54-b5ef-8292b915fc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:07.814532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1628af-0fd5-450d-a5de-483cdb01d670 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-af837283-e390-4f54-b5ef-8292b915fc3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:07.816782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:07.817788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:07.818630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 391/794] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:07.819316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.819714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.819830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.838269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:07.839466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:07.853453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:07.855035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.855317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.855584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.862772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:07.864250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-d21c9477-f074-493f-b28c-bd8a69dcbbf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:07.881824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:07.883038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:07.883908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 404/795] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:07.884847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cf5b-7ec6-4567-b966-1416b9e04cb3 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:07.884940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cf5b-7ec6-4567-b966-1416b9e04cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:07.885155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cf5b-7ec6-4567-b966-1416b9e04cb3 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:07.889268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 405/796] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:07.889268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cf5b-7ec6-4567-b966-1416b9e04cb3 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:07.917927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 392/797] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:07.918786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.008057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.011071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cf5b-7ec6-4567-b966-1416b9e04cb3 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.049517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.050210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.050491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.050766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.051570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:08.051873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.053311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec029-23c9-4d3d-b338-135fb37dc89f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.054029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8edf-735a-43ee-b246-4bbb56b7b994 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.062307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 406/798] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:08.063603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.063890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.064165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.080756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:08.082010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:08.084086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.099319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.099998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.100276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.100541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.101375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:08.101683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.103163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.121118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 393/799] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:08.121118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.155011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 407/800] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:08.156962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.231591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e6f84-fd24-485a-b2a5-250d53e77e53 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.258536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.267862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.268683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.268954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.269215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.273346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288efbf-ca47-47d1-94a7-d5a1a3c03ea8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.279436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:08.287483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:08.288501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:01:08.289379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:08.293699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 394/801] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:08.294471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.316051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69798b34-7417-458b-9117-1eda91783588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.316863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69798b34-7417-458b-9117-1eda91783588 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.317141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69798b34-7417-458b-9117-1eda91783588 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.317460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69798b34-7417-458b-9117-1eda91783588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.324941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.329653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69798b34-7417-458b-9117-1eda91783588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.331262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69798b34-7417-458b-9117-1eda91783588 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-69798b34-7417-458b-9117-1eda91783588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:08.349903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:08.350867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:08.351751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:08.351751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:08.351751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:08.351751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:08.351751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 408/802] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:08.352018 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69798b34-7417-458b-9117-1eda91783588 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.413326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2af63-d67c-4e4a-920e-d191f18803f9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.449352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.450286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.450524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.450794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/72c1b7dca4f0464c8f63394d348c95ad/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.453460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=72c1b7dca4f0464c8f63394d348c95ad, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.454870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.466504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69798b34-7417-458b-9117-1eda91783588 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.477255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 395/803] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:08 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/72c1b7dca4f0464c8f63394d348c95ad/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:01:08.477255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.514288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.515369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.515653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.515928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.516978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.519521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.532027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:08.540665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:08.541718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:01:08.542642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:08.545428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 409/804] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:08.546647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.610874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e113d9-8181-4ad0-a15e-f257d91010a5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.640594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.655481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.656449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.656759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.657038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.657897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:08.658329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.659866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.669308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 396/805] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:08.670055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.704231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92a6aa-4411-458b-9a1d-979f11987a4e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.743771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.744542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.744909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.745264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.746069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:08.746514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.747902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.761889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 410/806] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:08.767326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.805563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831d427-dca8-473e-ad2e-cd738a9b75cb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.815538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.841634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.842472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.842887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.843268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.844230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:08.844647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.846178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.851899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 397/807] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:08.857805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.885105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a298ed-8c61-4adc-9cca-75f8c9e14581 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:08.900475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:08.922770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:08.923517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:08.923791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:08.924058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:08.935132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:08.936644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:08.955730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:08.956678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:08.957620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:08.957620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:08.957620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:08.957620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:08.957620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 411/808] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:08.962700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:08.969355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc77de-0265-45ad-94f9-acb0d1e9618e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.012160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.013069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.013391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.013769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.022109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.023562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:09.039188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:09.040159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:09.041095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 398/809] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:09.041818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.072012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf8b87-02d9-4ec3-abfb-499d59517402 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.076061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.106693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.107372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.107644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.107918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.108722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:09.109023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.110469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da3191-1567-44f8-8bf3-83795742e784 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.117266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 412/810] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 20 09:01:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:09.117266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6502f3-6f0a-46c9-bd4f-49cda7d34973 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.117266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6502f3-6f0a-46c9-bd4f-49cda7d34973 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.117266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6502f3-6f0a-46c9-bd4f-49cda7d34973 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.118414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 413/811] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:09.118937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6502f3-6f0a-46c9-bd4f-49cda7d34973 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.154729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.159521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45fcf-0416-4085-b796-1a2b5173b8b9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.208777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.209540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.209901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.210268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.211060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:09.211362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.212771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.230891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 399/812] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:09.231629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.244184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6502f3-6f0a-46c9-bd4f-49cda7d34973 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.285170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.285898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.286178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.286452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.287312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:09.287617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.289102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afff752-61b1-4de0-b123-b5410c9ca203 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.313260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 414/813] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:09.313260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.313260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.313260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.330046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:09.331251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:09.347194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.356525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca810ea-f24c-4bba-a523-f07178bf6d55 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.395369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.396034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.396313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.396573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.397346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.398716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.416094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 415/814] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:09.417113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.430010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 400/815] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:09.430547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.449981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.557420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ff42-47af-40a0-8e77-a6f341ce7f4c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.558830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f456a8-0d98-49f3-910a-d68e4436771c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.597897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.598563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.598836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.599103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.599450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.600330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.600657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.601047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.613625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.615490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.617594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:09.636796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:09.637840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:09.638770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 416/816] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:09.640062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.688200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.689750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.745630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.753895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf55f-088e-4494-8ba4-638ca0d451ab None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.794313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 401/817] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:09.794537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.795165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.795339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.795587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.795905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] PATH_INFO: `/v3/services/network` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.796689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.798109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:09.811604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:09.812625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:01:09.813503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:09.817971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 417/818] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:09.818926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.848419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:09.905684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8106f1-fdb6-43cb-99f8-f71b1e60655a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.929129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35941874-17f9-4cae-8ca2-2d5462f05c6f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:09.941273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.941965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.942286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.942540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.943414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:09.943726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.945196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.967216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:09.968819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 402/819] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:09.969617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:09.969777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:09.970217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:09.970677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:09.983574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:09.985436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:09.996062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:10.008406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:10.009404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:10.010409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:10.010409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:10.010409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:10.010409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:10.011409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 418/820] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:10.012299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.081341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0a1fe-6076-4a55-aaf8-1adf3d9f4504 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.082932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.119221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.120007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.120353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.120732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.121547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] RBAC: Adding query filter params (name=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:10.121855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.123229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.125364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081dc3-eea0-4b6b-8a77-226e44fe3c31 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.133131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 403/821] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:10.134071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.163088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.163991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.164372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.164646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.176732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.178365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:10.197660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:10.199732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:10.201925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:10.201925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:10.201925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:10.201925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:10.205970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 419/822] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:10.205970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.241957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1bcf-35f9-406c-9bc7-6dd6b4c82997 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.259918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.278322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.279313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.279592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.280212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.280998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:10.281419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.283067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.314240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 404/823] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:10.314487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.332246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3446d-2992-4be0-be54-bdca2fdbd963 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.352093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.372532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.373050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.373709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.374207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.375101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] RBAC: Adding query filter params (type=network) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:10.375398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.376782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.387132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 420/824] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:10.387132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.457562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3def-dc1e-4535-ae97-533dc2705b5a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.497708 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f0d9-eb5e-4294-a4e2-acb28df34e6a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.501555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.502271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.502548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.502818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.503538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:10.503839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.505218 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.512195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.524197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 405/825] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:10.525342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.542701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.544518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.545043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.545796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.555712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.558333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:10.578253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:10.579241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:10.580169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:10.588281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 421/826] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:10.588281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.629771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.651366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2df27-c78c-4b02-b86e-7f7d8580d683 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.694261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.695292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.695792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.696144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.696921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.698422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.708547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85e80-7ffb-4398-a4da-2fc75f1325d1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.729286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 406/827] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:10.729286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.764547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.765897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.766256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.766631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.774725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.776346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-ff6bcfb4-c61b-4ab7-9f21-a6cbd6ca2a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:10.792229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:10.793279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:10.794185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:10.800718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 422/828] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:10.805886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1303b2c-9d81-4bd7-94cb-e2a68a1dbb0b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.805886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1303b2c-9d81-4bd7-94cb-e2a68a1dbb0b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.805886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1303b2c-9d81-4bd7-94cb-e2a68a1dbb0b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.805886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 423/829] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:10.805886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1303b2c-9d81-4bd7-94cb-e2a68a1dbb0b None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:10.840403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.867403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd5b2e-b720-4697-80cf-eb66a5f4d92b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.907002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.907715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.909056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.909165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.909993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:10.910307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.911906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82742fd-9515-4c8b-8f36-6459b31db061 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.925581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 407/830] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:10.926086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1303b2c-9d81-4bd7-94cb-e2a68a1dbb0b None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:10.926987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.927288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.927547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.935152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:10.951024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:10.952314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:10.975783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:10.976901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:10.977182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:10.977486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:10.978295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:10.978600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:10.980842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:10.996813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 424/831] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:10.997856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.051494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 408/832] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:11.052410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.109585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:11.128118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77747c-16d5-4cf8-8a4e-d4cb84704bba None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.158573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e264e2-8ca8-4565-b904-9df3d98ae619 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.164551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.165218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.165520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.165789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.166630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=3e99c32d943148cd8625c3ebd6c11887) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:11.166936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:11.168390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:11.174944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 425/833] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:10 2022] GET /identity/v3/role_assignments?user.id=3e99c32d943148cd8625c3ebd6c11887&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:11.175741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.207458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:11.215416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.216602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.217192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.217542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/36ab6b3da705454cb7369a68d1dd0f7b/roles/500c93384d994628af0bd2e13816f736` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.236638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=36ab6b3da705454cb7369a68d1dd0f7b, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:11.238169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:11.257295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 409/834] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:11 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/36ab6b3da705454cb7369a68d1dd0f7b/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:01:11.325051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446c95-f208-40f6-be09-6c03e69cf067 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.368996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.369808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.370089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.370363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.384148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:11.392268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:11.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:11.394113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 426/835] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:11.400228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.515996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14036207-1caa-4427-aef0-5b17a52a6d8c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.554374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.555061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.555450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.555942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.557053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:11.557396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:11.558813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767063ee-7d7f-4505-8f20-305e95e284f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:11.568952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 410/836] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:11.575208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.589194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:11.622426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2c58e-a057-44b9-bddc-120df6a7c109 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.622606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2c58e-a057-44b9-bddc-120df6a7c109 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.622887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2c58e-a057-44b9-bddc-120df6a7c109 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.625171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 411/837] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:11.634137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.634663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.634943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.658742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:11.660254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:11.695392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba43c4-aecc-4b0a-8679-371c72dade65 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.715358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:11.741012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.741866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.742443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.742726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.756499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:11.757368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 412/838] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:11.758025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:11.775858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:11.776595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:11.777644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:11.778736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:11.778736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:11.778736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:11.778736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:11.778736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 427/839] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:11.783879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.846904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:11.888385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441ddd-63cb-4724-8988-2eba0277332b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.894225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34199026-64a9-47ac-b576-7eb90342a8e4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:11.923425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.924138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.924408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.924675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.925440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:11.925746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:11.927166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:11.933784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:11.934900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:11.935323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:11.935735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:11.936781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:11.938567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:11.944491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 428/840] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:11.945433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:11.952926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:11.954158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:11.955138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:11.962707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 413/841] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:11.963999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:12.018264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:12.054693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107700bf-6854-4fff-8b2c-37c82fefcfef None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.079276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:12.091324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60686da-23b7-4d1f-8195-fac39422d9a7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.091497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.092212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.092583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.092986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.100921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.102153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:12.117403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:12.118519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:01:12.119668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:12.123846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 429/842] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:12.124711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:12.134270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.135131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.135681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.136120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.137105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:12.137586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.139347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.149916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 414/843] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:12.151413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:12.228663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7c4d-3a7a-4cfd-aeaf-a566ff58a61d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.263212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d8241-04bc-4a0e-984d-16c38d85a6f7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.263754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.264280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.264763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.265052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.265933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:12.266242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.266996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:12.267798 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.290736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 430/844] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 20 09:01:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:12.291646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:12.316066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.317379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.317947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.318457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.319448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:12.319948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.321667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.333778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 415/845] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:12.334834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:12.400590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b113-fd47-44a4-8ae7-4621a38158c6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.440856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.441573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.441855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.442130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.518460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.519929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.562048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:12.623378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 431/846] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:12.629271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:12.742564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b935d-0b91-4266-a4e1-f10476fe356f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.778932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.780337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.781253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.781731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.792867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.794681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:12.813538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:12.814496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:12.815374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:12.815374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:12.815374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:12.815374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:12.817699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 416/847] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:12.825181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:12.929523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922a7af-45f3-463e-acd5-0ac4ebdfdcc2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:12.967658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:12.968715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:12.969000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:12.969309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:12.970038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:12.970345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:12.971718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:12.980907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:12.985951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 432/848] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:12.991243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.012895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:13.102645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a00b8-3190-4098-82c3-1dee2cc38b28 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:13.138167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:13.138970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.139246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.139613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.147088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:13.148552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:13.163571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:13.164495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:13.165411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 417/849] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:13.172548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.279597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a71b3-2eed-4741-8903-d487ebad6e4c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:13.316020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:13.316689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.316967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.317260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.318058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:13.318366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:13.319803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603149f8-0e64-40df-bc9a-891dad72ce67 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:13.333357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 433/850] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:13.339482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.373161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591dfc-023c-4d4e-9bed-821531007b35 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.373525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591dfc-023c-4d4e-9bed-821531007b35 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.373840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591dfc-023c-4d4e-9bed-821531007b35 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.375746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 434/851] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:13.380707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6d2c-475f-464a-8b33-6017a3494c24 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.380982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6d2c-475f-464a-8b33-6017a3494c24 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.381283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6d2c-475f-464a-8b33-6017a3494c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.400226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-225d6d2c-475f-464a-8b33-6017a3494c24 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:13.401647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-225d6d2c-475f-464a-8b33-6017a3494c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:13.429959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:13.453671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99eca1-6372-4b81-b315-16a2b4e5504c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:13.464461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:13.477766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 435/852] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:13.487138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3eb99-c603-45ff-af31-dad58a3c4052 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.487651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3eb99-c603-45ff-af31-dad58a3c4052 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.488178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3eb99-c603-45ff-af31-dad58a3c4052 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.489913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:13.490494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 436/853] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:13.493722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.494170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.494664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.495571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=72c1b7dca4f0464c8f63394d348c95ad) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:13.495890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:13.497433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:13.498966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.499835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.500381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.504306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 418/854] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/role_assignments?user.id=72c1b7dca4f0464c8f63394d348c95ad&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:13.505508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.520618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:13.522338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:13.613714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 437/855] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:13.629856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.649615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b93f0-3a14-496d-a4a6-1f2d8a61c2ce None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:13.706113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:13.707733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.708163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.708768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.723222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:13.733846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:13.734824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:01:13.735629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:13.736263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 419/856] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:13.742146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.747383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:13.749355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce5426-f126-4c76-9503-4fc64d3af27a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:13.778686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:13.798646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:13.800496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.801023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.801677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.802458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:13.804722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:13.823685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:13.824741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:13.825605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:13.826374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 438/857] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:13.832070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.865833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29f468-e621-4263-a6cb-d90d822e46db None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:13.910131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:13.910845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:13.911125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:13.911397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:13.912284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:13.912578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:13.914057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:13.923679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 420/858] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:13.930587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:13.957510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf903db-6934-4bad-9fca-e4d649640ded None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.003110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.004647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.005293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.005882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.006985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:14.007510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:14.007716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.010139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.017257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 439/859] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:14.027138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:14.057536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dab88-c743-4697-b524-151f9c565e9a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.093435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:14.110613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.112337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.112767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.113210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.129071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.131118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.151798 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2939ae-d5c6-40d5-994a-91b30a928baf None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:14.156230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:14.157340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:14.158456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:14.158456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:14.158456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:14.158456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:14.160030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 421/860] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:14.165599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:14.195700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.196430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.196703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.196978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.197789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:14.198103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.199504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.213259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 440/861] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:14.297283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e60ed9-ab3b-42a9-82e6-6c7b6b7a3e68 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.317427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:14.339446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.340172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.340763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.340763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.341495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:14.341809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.343747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b71614-b940-4760-8a62-0eda360e2329 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.359266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 422/862] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:14.365026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:14.476184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a63ed0-5e7a-4010-b1f1-c86f9aaf7ffd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.491188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:14.513769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.515363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.515907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.516391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.525548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.527382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.539232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29d70f-45ee-4cf1-8c81-690f4f9de0d7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.539515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29d70f-45ee-4cf1-8c81-690f4f9de0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.539798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29d70f-45ee-4cf1-8c81-690f4f9de0d7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.542526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 423/863] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:14.543971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:14.544854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:14.545905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:14.546873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.546873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.547504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.549546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 441/864] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:01:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:14.556045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:14.570161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:14.571358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:14.645494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 424/865] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:14.668355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:14.674394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6454c72-952d-4e3e-9009-e9775a3812b8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.712991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.714135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.714618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.715117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.716218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:14.716726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.718715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.738884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 442/866] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 20 09:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:14.744256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:14.787640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:14.789166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12fad4-e87e-4bfe-914b-08a86995b0c0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.800927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:14.839891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.840629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.840876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.841154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:14.841962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:14.843407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:14.862844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 425/867] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:14 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:01:14.890227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12237f-1095-4f7c-a13d-4bf03d3427c2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:14.939822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:14.940755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:14.941175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:14.941612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.020592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:15.022375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:15.053567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:15.139192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 443/868] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:14 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:01:15.140689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:15.244126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6aad6-0921-4d6b-b946-f3d10fa077dc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:15.283202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:15.284509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.285011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.285552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.299996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:15.301491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:15.324645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:15.325794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:15.326768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:15.326768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:15.326768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:15.326768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:15.326768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 426/869] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:15.332041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:15.435837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cc1a4-4268-4426-9b31-9d616ec59add None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:15.464831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:15.474138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:15.474815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.475094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.475366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.476100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:15.476405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:15.477823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:15.495179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 444/870] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:15.498330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:15.521679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:15.602547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c633f1f-a669-435f-9219-1f07235f8b0e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:15.647083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:15.647953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.648236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.648507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.655553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:15.657096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f821ff1e-671d-4985-80e7-b863d345a587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:15.671629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:15.672548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:15.673630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 427/871] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:15.680435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:15.727104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4116426-f9ce-4ebf-90dd-dbf51dfa9c92 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.727445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4116426-f9ce-4ebf-90dd-dbf51dfa9c92 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.727650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4116426-f9ce-4ebf-90dd-dbf51dfa9c92 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.729694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 428/872] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:15.735072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.735354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.735632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.752762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:15.754195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:15.789221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679639-8396-44b1-a45a-eb602d22b197 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:15.823461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:15.824503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.825004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.825512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.826516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:15.827055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:15.828680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:15.829473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 429/873] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:15.847007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:15.850034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 445/874] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:15.857327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:15.883839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:15.903734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:15.954467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe3b2e-0336-4e77-b1d9-0fc07d5ae34d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:15.962716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6caa5-487b-448f-8387-ac41fdd484cb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:15.993565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:15.994653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:15.995131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:15.995730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:15.996537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:15.998380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:16.002186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:16.002709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:16.002991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:16.003264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:16.004109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=36ab6b3da705454cb7369a68d1dd0f7b) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:16.004421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:16.005908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:16.013192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:16.014451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:16.015402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:16.017333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 446/875] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:15 2022] GET /identity/v3/role_assignments?user.id=36ab6b3da705454cb7369a68d1dd0f7b&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:16.023034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 430/876] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:16.024337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:16.149881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da377-a4a6-4d67-8cc1-58d21a8b7ebd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:16.164892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:16.191972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:16.193043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:16.193621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:16.194070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:16.194967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:16.195271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:16.196678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c58ae-3490-4dae-852a-6a121cdaadf1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:16.203086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 447/877] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:16.208806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:16.285246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:16.326346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e47e-9c25-44d4-b370-986a43ac23ff None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:16.362902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:16.363585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:16.363976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:16.364265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:16.364989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:16.365324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:16.366800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97400a-25c6-459c-bb86-cddc9adddea5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:16.371961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 431/878] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:16.440196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f46f9-c881-4589-9ebf-dcba2c153160 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:16.440709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f46f9-c881-4589-9ebf-dcba2c153160 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:16.440709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f46f9-c881-4589-9ebf-dcba2c153160 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:16.442416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 448/879] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:16.448247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7df8e5-0cf8-44e8-ada8-8906b50bf9e1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:16.448535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7df8e5-0cf8-44e8-ada8-8906b50bf9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:16.448814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7df8e5-0cf8-44e8-ada8-8906b50bf9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:16.468347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ca7df8e5-0cf8-44e8-ada8-8906b50bf9e1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:16.469760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ca7df8e5-0cf8-44e8-ada8-8906b50bf9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:16.544495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 432/880] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:16.570105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f46f9-c881-4589-9ebf-dcba2c153160 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:16.684807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f46f9-c881-4589-9ebf-dcba2c153160 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:16.721747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee54665-a934-447c-b699-c9d9b3748e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:16.722388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee54665-a934-447c-b699-c9d9b3748e7e None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:16.722667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee54665-a934-447c-b699-c9d9b3748e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:16.722935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee54665-a934-447c-b699-c9d9b3748e7e None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:16.723686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee54665-a934-447c-b699-c9d9b3748e7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:16.725082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee54665-a934-447c-b699-c9d9b3748e7e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:16.746993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 449/881] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:16 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:17.009281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee351b0b-471b-4824-881c-48f4394ebbd7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.009669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee351b0b-471b-4824-881c-48f4394ebbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.009778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee351b0b-471b-4824-881c-48f4394ebbd7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.011455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 433/882] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:17.017044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.017364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.017636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.035117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:17.036335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:17.064079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:17.116939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 450/883] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:17.139822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee351b0b-471b-4824-881c-48f4394ebbd7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:17.208390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:17.250463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee351b0b-471b-4824-881c-48f4394ebbd7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:17.287511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:17.289213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.289763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.290221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.291076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:17.292724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:17.306801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:17.307848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:17.309927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 434/884] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:17.318632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:17.424086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde586-aa9d-4123-99f2-f0b01098e033 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:17.459295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:17.460042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.460282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.460729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.461464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:17.461809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:17.463259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:17.469009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 451/885] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:17.474994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:17.585742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc614-5fd7-486e-b55c-9512f7355d45 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:17.616016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:17.622194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35631794-fecd-4275-8175-14d50b145674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:17.622935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631794-fecd-4275-8175-14d50b145674 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.623226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631794-fecd-4275-8175-14d50b145674 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.623498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631794-fecd-4275-8175-14d50b145674 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.624495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35631794-fecd-4275-8175-14d50b145674 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:17.625252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35631794-fecd-4275-8175-14d50b145674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:17.627518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35631794-fecd-4275-8175-14d50b145674 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:17.634778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 435/886] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:17.640902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:17.668490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:17.745665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d003-3522-4844-8f52-474e6ebd7885 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:17.780178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:17.780863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.781137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.781435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.782234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] RBAC: Adding query filter params (interface=public, service_id=9130356adc8f41438e2a075c2a692f99, region_id=RegionOne) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:17.782535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:17.783936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd35ae6-6a72-4ed9-87b6-406c073ab175 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:17.789617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 452/887] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:17 2022] GET /identity/v3/endpoints?service_id=9130356adc8f41438e2a075c2a692f99&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:17.795305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35631794-fecd-4275-8175-14d50b145674 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:17.899802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35631794-fecd-4275-8175-14d50b145674 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:17.934841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee44907-0b77-40e0-a932-e79cb7610b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:17.935576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee44907-0b77-40e0-a932-e79cb7610b5d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:17.935851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee44907-0b77-40e0-a932-e79cb7610b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:17.936192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee44907-0b77-40e0-a932-e79cb7610b5d None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:17.937090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee44907-0b77-40e0-a932-e79cb7610b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:17.938524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee44907-0b77-40e0-a932-e79cb7610b5d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:17.944836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 436/888] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:17 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:01:18.322680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c45bb5-0ac6-47dc-960f-f334574ece36 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.323008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c45bb5-0ac6-47dc-960f-f334574ece36 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.323234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c45bb5-0ac6-47dc-960f-f334574ece36 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.324913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 453/889] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:18.330684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89a47-9791-4b4c-b217-10f9da29fa5c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.330975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89a47-9791-4b4c-b217-10f9da29fa5c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.331261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89a47-9791-4b4c-b217-10f9da29fa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.349627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-70f89a47-9791-4b4c-b217-10f9da29fa5c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:18.350845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-70f89a47-9791-4b4c-b217-10f9da29fa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:18.407448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:18.423009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 437/890] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:18.447485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c45bb5-0ac6-47dc-960f-f334574ece36 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:18.548230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:18.562836 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c45bb5-0ac6-47dc-960f-f334574ece36 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:18.600582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:18.601942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.602418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.602880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.614666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:18.620594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6932-3cc2-472a-b042-3b6133c0c8e3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.621115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6932-3cc2-472a-b042-3b6133c0c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.621195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6932-3cc2-472a-b042-3b6133c0c8e3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.622839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 438/891] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:18.623670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:18.625151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:18.626021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 454/892] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 20 09:01:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:18.628695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.628984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.633619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.636370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:18.654450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:18.656604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:18.745969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 439/893] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:18.763561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37b58-0d54-460e-9fbd-ad17aa761675 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:18.768644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:18.807700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:18.808416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.808690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.808959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.809763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:18.810070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:18.812088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:18.823289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 455/894] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:01:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:18.828908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:18.844266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:18.880449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a46ed-f9b2-4ab2-ac43-4ff9378c8bf5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:18.913617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:18.925881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cb46-a275-4a54-98e8-83730784bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:18.927104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cb46-a275-4a54-98e8-83730784bc66 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:18.927809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cb46-a275-4a54-98e8-83730784bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:18.928283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cb46-a275-4a54-98e8-83730784bc66 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:18.929387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cb46-a275-4a54-98e8-83730784bc66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:18.931116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cb46-a275-4a54-98e8-83730784bc66 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:18.953322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac10795-5f01-438d-ace1-fd10f6673483 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:18.953540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 440/895] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:18 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:01:19.003246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.004166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.004452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.004717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.018346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.019865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.028394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff04e-e649-4951-af2f-8a3dc98b5412 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.028719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff04e-e649-4951-af2f-8a3dc98b5412 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.028960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff04e-e649-4951-af2f-8a3dc98b5412 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.030764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 441/896] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:19.036565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.037205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.037700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:19.040147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:19.041060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:19.042000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:19.042000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:19.042000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:19.042000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:19.042000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 456/897] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:19.049166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.060333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:19.062144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:19.132211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:19.147590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 442/898] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:19.175326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.184357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16249-9334-48c7-8906-6cdb4ffd4783 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.229710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.230829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.231118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.231541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.232441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:19.232758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.235221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.254097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 457/899] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:19.259747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.293144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31434d8-4781-4743-95eb-74eeec49e016 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.303614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:19.332763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.334005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.334462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.334549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.335183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.336685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:19.350560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:19.351592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:19.352501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 443/900] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:19.359054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.377478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c3828-19a1-45ae-b75c-6d0c99647e24 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.397694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:19.416536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.417910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.418410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.418979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.427396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.429206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:19.445664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:19.446693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:19.447648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:19.455379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 458/901] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:19.456615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.473102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b5e3e-4cb8-47ba-86e6-15e040ad93d3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.510475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.511169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.511443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.511711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.512426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:19.512698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.514113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.524489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 444/902] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:19.525802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.570430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:19.576238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50ab2-3e75-4161-ac9f-001cd4a01a7d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.637340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.637340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.637340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.637340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.637769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:19.637769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.637769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.657548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82bc4e-9176-43c1-9ae8-3093c14097ab None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.659613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 459/903] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:19.665211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.710913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:19.714840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.715624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.715969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.716301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.717103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:19.717674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.720358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.728130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 445/904] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:19.734878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.789585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f34692-54ae-4bc2-be46-8122e77ef6a1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.834306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.835957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.836340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.836742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.866552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:19.870253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27f55a-31dd-4103-98e2-c94e024a3f59 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:19.910050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:19.910756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:19.911032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:19.911304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:19.912204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] RBAC: Adding query filter params (interface=public, service_id=02ded005de914684b63e81968bd12c32, region_id=RegionOne) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:19.912522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.914020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.922771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 446/905] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/endpoints?service_id=02ded005de914684b63e81968bd12c32&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:19.928262 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:19.930670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:19.932219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:19.967182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.043095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 460/906] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:01:20.054290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.061665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b681e0-bbe2-4768-a82f-b71b61a00620 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.100007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4fe47-666a-4c0f-954a-36f9484c98af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.100690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4fe47-666a-4c0f-954a-36f9484c98af None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.100963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4fe47-666a-4c0f-954a-36f9484c98af None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.101246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4fe47-666a-4c0f-954a-36f9484c98af None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.102089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4fe47-666a-4c0f-954a-36f9484c98af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.104126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4fe47-666a-4c0f-954a-36f9484c98af None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.117428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 447/907] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:19 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:01:20.145064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14b9cf-4c6f-4cd4-84c5-491b5f9fd2f9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.145455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14b9cf-4c6f-4cd4-84c5-491b5f9fd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.145655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14b9cf-4c6f-4cd4-84c5-491b5f9fd2f9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.147427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 448/908] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:20.153296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.153652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.153859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.172512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:20.173720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:20.195969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de0e2-4c61-4dd8-9e20-7d5b69d864b3 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.202769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.255283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.256648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.257132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.257665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.261151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.261624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 449/909] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:20.271890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.273785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.281946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:20.300799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:20.301801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:20.302672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:20.302672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:20.302672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:20.302672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:20.305317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 461/910] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:20.308872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.407385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb36aa7-86f9-465e-b96c-ef0acab7f55a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.417926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97259a-b820-4123-8c5b-cf6a7d1c8e18 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.447070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.447898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.448182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.448453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.449116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.450678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.454731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.455591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.456011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.456421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.457317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:20.457829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.459387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:20.464469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:20.465713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:01:20.466725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:20.473849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 450/911] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:20.477039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.486123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 462/912] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:20.487497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.516822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.551570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.604992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e811f1-7355-4d0c-a497-627b3657a4bc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.629008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6b09-8d46-4bc0-8dcd-fefa5fae62c2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.641661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.642438 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.642792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.643144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.643910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:20.644302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.645813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.656125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 451/913] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:20.657095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.674172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.675031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.675381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.675784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.683346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.684767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:20.700218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:20.701125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:20.702322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:20.706595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 463/914] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:20.707569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.777600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.800784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dbe9d-dded-4fcd-88c6-114f954ecfc4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.813114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdb929-6a9c-498b-9d84-e80dfde015fd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:20.823243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:20.851280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.852370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.852982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.853481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.854630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:20.854951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:20.855423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:20.855606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.855762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:20.856142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:20.856992 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:20.857384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:20.858053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.859030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:20.865469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 452/915] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:20.870726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:20.882356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 464/916] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:20.883265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:21.000383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64670d-9c10-4fd8-9f9b-da9562a43da3 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:21.004334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10bf09-9956-4335-90d0-d9a885dfc20c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:21.040526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92796-1c7e-422b-801d-f707cdb7afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:21.041379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92796-1c7e-422b-801d-f707cdb7afdb None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.041765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92796-1c7e-422b-801d-f707cdb7afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.042127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92796-1c7e-422b-801d-f707cdb7afdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.042959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92796-1c7e-422b-801d-f707cdb7afdb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:21.044446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92796-1c7e-422b-801d-f707cdb7afdb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:21.049791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:21.050461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.050734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.050999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.051833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] RBAC: Adding query filter params (role.id=4abcfbe97c5f4d9d9c52db3f000af8a4, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=36ab6b3da705454cb7369a68d1dd0f7b) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:21.052140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:21.053587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b0bd-c30f-4305-a031-ae863f82714d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:21.063707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 465/917] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:20 2022] GET /identity/v3/role_assignments?user.id=36ab6b3da705454cb7369a68d1dd0f7b&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=4abcfbe97c5f4d9d9c52db3f000af8a4 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:21.078859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 453/918] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:01:21.133435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91c8b-8175-4ca6-a17b-4fa9becf3cf9 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.133800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91c8b-8175-4ca6-a17b-4fa9becf3cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.133993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91c8b-8175-4ca6-a17b-4fa9becf3cf9 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.135705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 466/919] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:21.141776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.142135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.142334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.156428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:21.162452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:21.163689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:21.255447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 454/920] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:21.278463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91c8b-8175-4ca6-a17b-4fa9becf3cf9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:21.322348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:21.405317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91c8b-8175-4ca6-a17b-4fa9becf3cf9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:21.440607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:21.441480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.441758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.442035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.442692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:21.444088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:21.456685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:21.457766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:21.458574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:21.463009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 467/921] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:21.464380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:21.569710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07180c2e-ad62-4e06-918e-fea261fafe4a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:21.601300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:21.607700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:21.608500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.608783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.609058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.609832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:21.610211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:21.611796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:21.621352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 455/922] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:21.623381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:21.731834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:21.742353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17755c-2e31-4647-98c8-af5f54d721ba None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:21.777864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:21.778940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.779431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.779965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.780914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:21.781495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:21.783106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:21.793327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 468/923] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:21.795288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:21.907722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6dc4f-a234-4523-983d-4404c73a7b23 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:21.943440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:21.944110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:21.944387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:21.944659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:21.945479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] RBAC: Adding query filter params (interface=public, service_id=7d03c6197c2e404f8808380b35093f1e, region_id=RegionOne) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:21.945786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:21.947163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba23e0-3d72-4d39-a6f8-b84e08009787 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:21.953089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 456/924] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:21 2022] GET /identity/v3/endpoints?service_id=7d03c6197c2e404f8808380b35093f1e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:21.958835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:22.064353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569562c6-2c53-4d38-bca8-e1d58b3707ce None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:22.099287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ca946-ce2f-4b2a-9afa-d6b7638f9582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:22.099959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca946-ce2f-4b2a-9afa-d6b7638f9582 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:22.100233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca946-ce2f-4b2a-9afa-d6b7638f9582 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:22.100508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca946-ce2f-4b2a-9afa-d6b7638f9582 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:22.101189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca946-ce2f-4b2a-9afa-d6b7638f9582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:22.102607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca946-ce2f-4b2a-9afa-d6b7638f9582 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:22.109648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 469/925] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:21 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:01:22.224959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e0e67-18e4-450f-92da-efb6630cab29 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:22.225149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e0e67-18e4-450f-92da-efb6630cab29 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:22.225456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e0e67-18e4-450f-92da-efb6630cab29 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:22.227248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 457/926] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:22.233642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:22.234084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:22.234228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:22.258305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:22.259525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:22.278794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:22.343445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 470/927] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:22.366233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e0e67-18e4-450f-92da-efb6630cab29 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:22.435355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:22.481253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e0e67-18e4-450f-92da-efb6630cab29 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:22.518888 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:22.519721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:22.519996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:22.520261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:22.520912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:22.522355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:22.535173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:22.536131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:22.537150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 458/928] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 20 09:01:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:22.542844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:22.653460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12081d15-0146-4009-8e99-31d4f2667b0e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:22.692921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:22.693627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:22.693900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:22.694170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:22.694884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:22.695187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:22.696561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:22.702026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 471/929] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:22.707806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:22.824103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e075227-0259-443d-a24a-0f081689b00e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:22.851627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:22.863626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:22.864300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:22.864578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:22.864849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:22.865579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:22.865881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:22.867246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06107ded-c742-43c5-b379-7c9147eaf7ea None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:22.872769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 459/930] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:22.878497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:22.898985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:22.993272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383b23-2d57-4e92-a786-2f180b72dc05 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:23.033843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473d4d-2b68-4feb-b9b3-50f8a8c59e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:23.034916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473d4d-2b68-4feb-b9b3-50f8a8c59e56 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.035396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473d4d-2b68-4feb-b9b3-50f8a8c59e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.035962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473d4d-2b68-4feb-b9b3-50f8a8c59e56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.036952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73473d4d-2b68-4feb-b9b3-50f8a8c59e56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:23.038592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73473d4d-2b68-4feb-b9b3-50f8a8c59e56 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:23.063727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 472/931] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:23.434951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507560-5635-4443-8a0e-f577445d0454 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.435358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507560-5635-4443-8a0e-f577445d0454 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.435543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507560-5635-4443-8a0e-f577445d0454 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.437654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 460/932] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:23.442885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.443178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.443456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.463010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:23.464403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:23.469436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c346d2f-218c-45b4-91af-9b8811d9b8db None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.470036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c346d2f-218c-45b4-91af-9b8811d9b8db None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.470515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c346d2f-218c-45b4-91af-9b8811d9b8db None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.472413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 461/933] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:23.479232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.480032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.480511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.504041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:23.505813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:23.541111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:23.553326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 473/934] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:23.573164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:23.595340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 462/935] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:23.618501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:23.686838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bc46-2842-4e69-ad51-0ebb5c6b75de None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:23.728032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:23.729027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.729330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.729611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.730326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:23.731965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:23.733663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING keystone.server.flask.common [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 09:01:23.743539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec32d3f-a786-4c4b-97a0-4be2c10a0a88 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:23.754887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.sql.core [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 09:01:23.754887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 09:01:23.754887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [parameters: {'id': 'bd544a12cd9d4b2faeb9992a441021cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 09:01:23.754887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80405) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd544a12cd9d4b2faeb9992a441021cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd544a12cd9d4b2faeb9992a441021cc. Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:01:23.763446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result.read() Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 09:01:23.764462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application yield resource Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise self.value Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application session.commit() Jul 20 09:01:23.770908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.session.flush() Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application compat.raise_( Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 09:01:23.772347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 09:01:23.773325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application result.read() Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:01:23.774192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [parameters: {'id': 'bd544a12cd9d4b2faeb9992a441021cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:23.778192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:23.780895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd544a12cd9d4b2faeb9992a441021cc. Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.784502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 474/936] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Jul 20 09:01:23 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:23.785858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:23.786040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:23.804389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:23.805593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.806138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.806627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.818756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:23.828246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:23.829683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:23.830556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:23.833474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 463/937] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 20 09:01:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:23.839105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:23.854521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:23.912356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276dcb-c49f-4656-8987-f0ea2df54914 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:23.957597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8108af-7743-4f90-aaf0-d26a63b80e08 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:23.961106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:23.962120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.962550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.963016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:23.972532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:23.975181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:23.994856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:23.995969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:23.997015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:23.997524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:23.998279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:23.998807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:23.999723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 475/938] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:24.001336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.002294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:24.002731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.004354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.005799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.021074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 464/939] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:01:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:24.023762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.076098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:24.122454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c3ab-09df-42f6-87ce-1566b7ee3ecd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.139818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747452f-91af-4230-96af-302580dd64c7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.140509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:24.161863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.162537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.162818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.163092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.164017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:24.164516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.166007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.181470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.182677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.183162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.183645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.195996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.197418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 476/940] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:24.198190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-44d9f5bf-94fc-4ded-b61c-87d0fab2f80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:24.219529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:24.220529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:24.221564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:24.221564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:24.221564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:24.221564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:24.224123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 465/941] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:24.230915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.338695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c20f8-dcca-4980-adcf-00e34802d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.339347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c20f8-dcca-4980-adcf-00e34802d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.339824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c20f8-dcca-4980-adcf-00e34802d6f0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.341452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 466/942] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:24.347666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.348551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.349033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.356086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0f04-5771-45e3-8c4a-6bf448e3d7d2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.372618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:24.375023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:24.394762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.395434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.395710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.395990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.396743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:24.397045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.398479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.410901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 477/943] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:24.417942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.457511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 467/944] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:24.468646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:24.485008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.512478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:24.554943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247925e8-2075-46fb-98b4-7e3a95819cdb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.598162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2243e1-57f8-4ff9-adca-d06cc8ea5875 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.606519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.607437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.607811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.608257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.621617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.623832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.638484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.639841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.640307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.640761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.641647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.643293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:24.644880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:24.645835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:24.646790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:24.649320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 478/945] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:24.652877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:24.662655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:24.663700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:24.664532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:24.667588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 468/946] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:24.673410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.757542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:24.765408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348ecf-84f6-4e97-929e-a56d12c023f4 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.767384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:24.785600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd1b98-0d71-4824-af43-bed2ebef54e5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.803734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.804761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.805299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.805771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.806844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:24.807408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.809078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.822524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.823201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.823482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.823757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.824470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:24.824775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.826417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.830462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 479/947] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:24.836126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.837205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 469/948] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:24.846409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:24.944381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e20ec2-f23d-4299-be30-44f5eedadf0d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.954690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d6bd-45b7-4834-8945-004ea4731393 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:24.980371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.981172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.981486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.981758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.993291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.993625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:24.994520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:24.994855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:24.995168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:24.995763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:24.996646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:24.997364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:24.999674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.006802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 470/949] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:25.014375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:25.020675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:25.021629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:25.022556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:25.022556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:25.022556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:25.022556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:25.030300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 480/950] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:25.032511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.036119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.047638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.153063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3788-9bdb-4979-b834-e83e2d21ef36 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.170433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772f84-7aa4-47fb-aca2-c24708ad0139 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.192971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.193777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.194109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.194589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.195334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.196863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.204518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.205179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.205486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.205754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.206506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:25.206763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.208251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8dbc9-e650-4729-8dfa-b44d36bc138f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.225286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 481/951] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:25.225286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe4810-454d-4ac5-8e37-df5e320aa1f1 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.225286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe4810-454d-4ac5-8e37-df5e320aa1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.225286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe4810-454d-4ac5-8e37-df5e320aa1f1 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.226133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 471/952] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:25.227333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.228159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 482/953] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:25.231892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.231892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.231892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.258628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:25.260953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:25.322358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.350446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.362055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676ddae-b7c2-43cb-ae2c-e1b8b90fc8b0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.369256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 483/954] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:25.386765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.410234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.411623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.411623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.411806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.419336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.421016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:25.436806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:25.438000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:25.439082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 472/955] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:25.444141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.509987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2038dd-1ec5-452c-b9ed-e40f8102a135 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.547206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.548124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.548454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.548791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.549539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.550908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:25.564119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:25.565358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:25.566235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:25.567106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 484/956] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:25.572343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.581587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340307c-23d4-4382-82f2-08bb8174edb9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.616889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.620783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.621901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.622391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.622907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.624387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:25.624959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.626673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.631260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.641995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 473/957] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:25.653279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.677277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8ae8-e0b3-4456-8762-60fd7e96f333 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.712382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.713509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.713928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.714338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.715208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] RBAC: Adding query filter params (name=compute) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:25.715662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.717694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.723736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 485/958] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:25.729607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:25.782491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8efe0-2b60-434f-91c1-a51f0a42c603 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.822777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5584ffa-c678-449a-8146-2e440fcb1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.824503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5584ffa-c678-449a-8146-2e440fcb1e18 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.824790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5584ffa-c678-449a-8146-2e440fcb1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.825069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5584ffa-c678-449a-8146-2e440fcb1e18 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/36ab6b3da705454cb7369a68d1dd0f7b/roles/4abcfbe97c5f4d9d9c52db3f000af8a4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.827864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5584ffa-c678-449a-8146-2e440fcb1e18 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=36ab6b3da705454cb7369a68d1dd0f7b, role_id=4abcfbe97c5f4d9d9c52db3f000af8a4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.829381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5584ffa-c678-449a-8146-2e440fcb1e18 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.849134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 474/959] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:25 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/36ab6b3da705454cb7369a68d1dd0f7b/roles/4abcfbe97c5f4d9d9c52db3f000af8a4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:01:25.862462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a05e-f12f-4192-a4ba-52f56e6aa9df None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:25.889043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:25.906311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:25.907034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:25.907344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:25.907615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:25.908380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:25.908680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:25.910120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5bb2c-873d-4a0d-ab41-d8f4a6ef5e29 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:25.916303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 486/960] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:26.469991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925204b-4adb-4811-bbeb-3a5f05f8ba32 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:26.470387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925204b-4adb-4811-bbeb-3a5f05f8ba32 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:26.470611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925204b-4adb-4811-bbeb-3a5f05f8ba32 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:26.472165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 475/961] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:26.477975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:26.478509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:26.478509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:26.496104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:26.497328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:26.571746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 487/962] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:26.596425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925204b-4adb-4811-bbeb-3a5f05f8ba32 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:26.648983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:26.702018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925204b-4adb-4811-bbeb-3a5f05f8ba32 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:26.741981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:26.742651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:26.742925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:26.743196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:26.743894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:26.745440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:26.746842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING keystone.server.flask.common [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 09:01:26.759458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.sql.core [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 09:01:26.759458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 09:01:26.759458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [parameters: {'user_id': '84bfca020d984332b8c92b81e1952002', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 09:01:26.759458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jul 20 09:01:26.777452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:01:26.778373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application yield resource Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise self.value Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application session.commit() Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 09:01:26.779337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.flush() Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application compat.raise_( Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 09:01:26.780741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:01:26.782861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:01:26.784857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [parameters: {'user_id': '84bfca020d984332b8c92b81e1952002', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:26.786884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 09:01:26.789435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:26.790398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 476/963] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 20 09:01:26 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:26.790797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:26.890964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9413027-1148-4008-ade0-c82e22435e38 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:26.906219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:26.927817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:26.928979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:26.929482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:26.930002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:26.941905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:26.943394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-83d4a1c0-c31e-43a6-b7a7-cf369a48f717 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:26.958676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:26.959686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:26.960639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 488/964] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:26.968887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:27.075427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eceb5-0253-4048-a9cc-4101b87f92a4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:27.092291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:27.116051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:27.116772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:27.117311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:27.117774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:27.118658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:27.119257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:27.120982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946c64d-2eba-4532-ab8d-db46f3ba381a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:27.161926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 477/965] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 20 09:01:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:27.462502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a023ab-b304-4543-b0e9-65297ef1f2a2 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:27.462717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a023ab-b304-4543-b0e9-65297ef1f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:27.463020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a023ab-b304-4543-b0e9-65297ef1f2a2 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:27.464613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 489/966] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:27.470480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:27.470735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:27.471048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:27.489718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:27.491283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:27.565963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 478/967] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:27.589711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a023ab-b304-4543-b0e9-65297ef1f2a2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:27.697862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a023ab-b304-4543-b0e9-65297ef1f2a2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:27.734107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:27.734855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:27.735142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:27.735424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:27.736088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:27.737531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:27.750362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:27.751389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:27.752248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:27.753768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 490/968] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:27.757848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:27.865848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:27.869659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770924d-8d0f-480a-ac14-aa4df1ee1f56 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:27.906753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:27.907426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:27.907697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:27.907974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:27.908699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:27.908999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:27.910458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155e2a3-8513-4dd0-a89e-a45035f71ed5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:27.916051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 479/969] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:27.921954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:27.963343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:28.026499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243adfc7-d42a-4a3b-97a3-046443cb762e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.062919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.063587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.064275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.064275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.064967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:28.065253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.066059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cfafb-40ec-45b7-9953-335c5a709465 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.066552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cfafb-40ec-45b7-9953-335c5a709465 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.066641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cfafb-40ec-45b7-9953-335c5a709465 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.066761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.068063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 480/970] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:28.077573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 491/971] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:28.077753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ee016-c37a-438b-9c14-75294173f564 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.077753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ee016-c37a-438b-9c14-75294173f564 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.077753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ee016-c37a-438b-9c14-75294173f564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.078642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.092576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fb1ee016-c37a-438b-9c14-75294173f564 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:28.093863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fb1ee016-c37a-438b-9c14-75294173f564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:28.164598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 481/972] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:28.166026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274122-7f05-4659-8f72-02a5447b2da8 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.166307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274122-7f05-4659-8f72-02a5447b2da8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.166579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274122-7f05-4659-8f72-02a5447b2da8 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.167993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 482/973] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:28.173767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.174268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.174690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.185102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca920a3-3c2c-4fbf-8531-dcd57e5f6b22 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.186768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:28.192627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:28.193855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:28.221739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.222444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.222714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.222985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.223797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] RBAC: Adding query filter params (interface=admin, service_id=7d03c6197c2e404f8808380b35093f1e, region_id=RegionOne) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:28.224110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.225509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.231706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 492/974] 10.222.0.67 () {56 vars in 1249 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/endpoints?service_id=7d03c6197c2e404f8808380b35093f1e&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:28.232518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.263289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 483/975] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:28.269561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.292100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:28.342484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bea4-2e37-4668-b2f8-7dc5713d10b0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.375583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1219448-f821-4bc5-8b5f-9c8ccb5eeb03 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.384075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.384942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.385215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.385519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.396851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:28.405349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:28.406511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:28.407361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 493/976] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:28.408098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.410422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.411139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.411411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.411937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.412657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.414282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.420518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 484/977] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:01:28.421312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.439680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:28.527818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f863-46c1-419f-b44e-a9868925b218 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.541029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:28.555155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1021c-d742-42ca-bfff-5dd54475abfc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.567684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.568530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.568923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.569309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.570230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.571857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.591195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 494/978] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:28 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:28.602051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.602485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.602765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.603038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.604265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:28.604559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.606151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.617873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 485/979] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:28.624115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.724217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:28.743377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942aa9c-3aa0-4f91-af07-bbb141478a26 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.784667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.786342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.786342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.786342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.798165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.799646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:28.819158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:28.820097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:28.821092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:28.821092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:28.821092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:28.821092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:28.821092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 495/980] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:28.827705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:28.940139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40551-f6f4-42aa-9b95-6d3163688aa9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:28.975735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:28.976412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:28.976693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:28.976962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:28.977718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:28.978020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:28.979726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:28.992282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 486/981] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:28.998225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:29.104438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656a9a9-deff-46b1-999e-a3c34b6f7d59 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:29.139817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:29.140725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:29.141002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:29.141309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:29.148975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:29.150482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:29.152396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:29.168749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:29.169835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:01:29.170824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:29.173334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 496/982] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:01:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:29.176097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:29.186407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:29.287379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8474b1-8d14-4429-8a64-3aeb3bb9ae65 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:29.327151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:29.327965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:29.328244 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:29.328511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:29.329380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:29.329683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:29.331184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:29.350006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 487/983] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 20 09:01:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:29.356236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:29.473575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda8c65-9e5f-4530-95cb-8ff4f1943f77 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:29.508987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:29.509868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:29.510246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:29.510611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:29.579676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:29.584442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:29.586416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:29.693284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 497/984] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:29.698930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:29.766636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:29.806859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a402bf-c533-4390-b7a1-8c0c8b4edd0e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:29.844996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:29.845840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:29.846113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:29.846380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:29.857414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:29.859090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:29.876670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:29.877709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:29.878629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:29.878629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:29.878629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:29.878629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:29.878629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 488/985] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:29.883638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:29.984670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:29.987462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbf4ee-44f2-4e48-9cf7-fa04a8a74261 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.023067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:30.023745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.024021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.024289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.025016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:30.025340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:30.026746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:30.038709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 498/986] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:30.044272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:30.152638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6f69-ba58-494e-b86e-deedc7d87828 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.171051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:30.190357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:30.191171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.191489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.191728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.198769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:30.200217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:30.214509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:30.215412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:30.221730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 489/987] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:30.222223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:30.337619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a97282-abfa-42bd-a34d-fdd2a6ae3863 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.374338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:30.375370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.375990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.376457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.377453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:30.377957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:30.379551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41462424-b6a0-4b6b-9eb8-c5cada768c54 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:30.398168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 499/988] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:30.399742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:30.507494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661d716-bb2b-48b2-ac64-25f298c5c70a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.541980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:30.542640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.542917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.543183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.544012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] RBAC: Adding query filter params (role.id=4abcfbe97c5f4d9d9c52db3f000af8a4, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=36ab6b3da705454cb7369a68d1dd0f7b) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:30.544319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:30.546245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaab43e-1be8-4b82-8a39-5b67a745933f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:30.561149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 490/989] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/role_assignments?user.id=36ab6b3da705454cb7369a68d1dd0f7b&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=4abcfbe97c5f4d9d9c52db3f000af8a4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:30.561486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e190a6-94f1-41ab-8ffe-ce5e8681c3ff None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.561486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e190a6-94f1-41ab-8ffe-ce5e8681c3ff None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.561486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e190a6-94f1-41ab-8ffe-ce5e8681c3ff None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.561486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 500/990] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:30.563223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18f322-f2e0-4482-abd6-9e5f81893a4f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.563527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18f322-f2e0-4482-abd6-9e5f81893a4f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.563773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18f322-f2e0-4482-abd6-9e5f81893a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.583184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ad18f322-f2e0-4482-abd6-9e5f81893a4f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:30.584418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ad18f322-f2e0-4482-abd6-9e5f81893a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:30.627152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:30.665684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 491/991] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:30.688650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e190a6-94f1-41ab-8ffe-ce5e8681c3ff None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:30.703610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369987-9612-4df0-bf5b-6ff76411f188 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.703904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369987-9612-4df0-bf5b-6ff76411f188 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.704204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369987-9612-4df0-bf5b-6ff76411f188 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.705670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 492/992] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:30.710728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:30.711270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.711861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.711861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.732443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:30.733810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:30.805674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 493/993] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:30.819177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e190a6-94f1-41ab-8ffe-ce5e8681c3ff None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.828749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:30.857882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:30.858709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.858991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.859262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.859914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:30.861316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:30.873759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:30.874781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:30.876514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 501/994] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:30.880999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:30.934165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:30.938034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c35d6b-0ae4-46aa-96aa-8b51975ca0f2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.966561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:30.975062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:30.976130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:30.976558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:30.976873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:30.977868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:30.979741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:30.987238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4f8d9-e39e-4c3b-9a39-ecd9e4e8a274 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:30.991571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:30.992536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:30.993594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 494/995] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:30.999528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:31.034783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.036721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.037210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.037719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.038622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:31.039160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.041146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.048859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 502/996] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:31.054193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:31.109563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a3e38-c64b-4aea-bd37-bc1174b300e1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:31.145187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.145879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.146154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.146642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.147133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:31.147429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.148792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.158748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 495/997] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:31.159803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:31.167938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f168613-008a-4d31-9dc1-31435c27d42c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:31.188410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:31.206458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.207124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.207398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.207666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.208363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:31.208658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.210339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.220283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 503/998] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 20 09:01:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:31.221263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:31.235187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:31.269522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137af97-9a29-481c-9289-5e96c4f30311 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:31.314861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.315552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.315869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.316217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.316965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:31.317260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.318664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.329570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 496/999] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:31.331232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:31.333834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a64bcb-0d32-4d65-aa64-2a0f8f27b55b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:31.370792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.371369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.371645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.371915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.372649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.374081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.401279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 504/1000] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:31.442219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:31.454352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b648-8660-429d-a875-90538c8f0653 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:31.502383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.503087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.503360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.503626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.505096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] RBAC: Adding query filter params (interface=public, service_id=f3f56e06723a4fb1b7c2f5c67923b0bc, region_id=RegionOne) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:31.505429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.506807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88233c-238e-49c9-8bc8-510308c8d9f0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.512863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 497/1001] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:31 2022] GET /identity/v3/endpoints?service_id=f3f56e06723a4fb1b7c2f5c67923b0bc&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:31.518937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:31.599178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:31.632277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056f9d-9ccb-4bad-9c62-dc0b430d99f8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:31.667774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a25d4e-50b6-4ace-ba2f-5924cbb6bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:31.668456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a25d4e-50b6-4ace-ba2f-5924cbb6bafe None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:31.668724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a25d4e-50b6-4ace-ba2f-5924cbb6bafe None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:31.668996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a25d4e-50b6-4ace-ba2f-5924cbb6bafe None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:31.669720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a25d4e-50b6-4ace-ba2f-5924cbb6bafe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:31.671302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a25d4e-50b6-4ace-ba2f-5924cbb6bafe None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:31.678405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 505/1002] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:31 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:01:32.673104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70383a9-46ce-4798-8cb0-aab6992bd447 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:32.673711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70383a9-46ce-4798-8cb0-aab6992bd447 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:32.673711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70383a9-46ce-4798-8cb0-aab6992bd447 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:32.675170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 498/1003] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:32.680617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:32.681043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:32.681247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:32.699442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:32.700641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:32.771346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 506/1004] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:32.794423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70383a9-46ce-4798-8cb0-aab6992bd447 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:32.902900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70383a9-46ce-4798-8cb0-aab6992bd447 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:32.937729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:32.938458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:32.938732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:32.939002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] PATH_INFO: `/v3/services/image` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:32.939640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:32.941010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:32.952975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:32.954112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:32.954939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:32.957592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 499/1005] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 20 09:01:32 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:32.960236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:33.026242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:33.066372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad145-c8e1-4bb8-bec9-7062d51cd6d9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:33.102232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:33.102895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.103172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.103795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.104512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:33.104814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:33.106241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed95a3-18c2-49a8-8e3c-12946d2639e5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:33.116076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 507/1006] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:33.117556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:33.137829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:33.222568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5560f-db1a-49b0-8228-45ffb9e72213 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:33.257113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:33.257811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.258091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.258361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.259069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] RBAC: Adding query filter params (type=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:33.259372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:33.260751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18adbb-7654-4aaa-a3b1-0d0ef8b8c037 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:33.265564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 500/1007] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:33.488119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b7e6-13f1-4c73-b8d5-95bf93e3dc83 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.488567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b7e6-13f1-4c73-b8d5-95bf93e3dc83 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.489005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b7e6-13f1-4c73-b8d5-95bf93e3dc83 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.491785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 508/1008] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:33 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:33.498415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20f63-ec8c-41b0-baa0-2c446c95d835 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.498919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20f63-ec8c-41b0-baa0-2c446c95d835 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.499145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20f63-ec8c-41b0-baa0-2c446c95d835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.516531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d6e20f63-ec8c-41b0-baa0-2c446c95d835 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:33.517751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d6e20f63-ec8c-41b0-baa0-2c446c95d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:33.589276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 501/1009] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:33.613614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13b7e6-13f1-4c73-b8d5-95bf93e3dc83 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:33.721888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13b7e6-13f1-4c73-b8d5-95bf93e3dc83 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:33.738554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c6de-be28-4abf-b8c9-620e8cccf4d2 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.739039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c6de-be28-4abf-b8c9-620e8cccf4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.739039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c6de-be28-4abf-b8c9-620e8cccf4d2 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.740560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 502/1010] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:33.745662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.745947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.746224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.751592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:33.760162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:33.760966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.761294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.761523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.762694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:33.763388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:33.764384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:33.764618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:33.766451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 509/1011] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:33.767623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:33.772558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:33.846179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 503/1012] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:33.869405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:33.883108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8999b4-4f50-45dc-a5fc-8e972a922da1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:33.927717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:33.928491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:33.928767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:33.929036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:33.929772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:33.931330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:33.959953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 510/1013] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:33 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:33.995593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d22667-99c0-466f-adb4-dd87e722c86b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:34.036302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:34.037538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:34.038026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:34.038480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:34.039323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:34.040984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:34.054642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:34.055736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:01:34.056592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:34.059009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 504/1014] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:34.065864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:34.127198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:34.182036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35698b-6d6e-4f43-bc1d-2968669916aa None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:34.218187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:34.218871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:34.219150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:34.219453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:34.220231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:34.220539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:34.221975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:34.233157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 511/1015] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:34.234714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:34.239537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:34.349208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a08e-1e4d-48dd-a9c5-02ca0e9fd263 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:34.384442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:34.385117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:34.385424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:34.385697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:34.386398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:34.386761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:34.388188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaea3fc-b7ee-4f6f-bef8-32e965bbc1e7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:34.397850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 505/1016] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 20 09:01:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:34.399101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:34.505761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67353e44-96ed-4386-9b85-5aeb8618f9a2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:34.519360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:34.542773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50531890-346b-450e-ab7b-fb57c0f3068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:34.543435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50531890-346b-450e-ab7b-fb57c0f3068d None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:34.543709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50531890-346b-450e-ab7b-fb57c0f3068d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:34.543977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50531890-346b-450e-ab7b-fb57c0f3068d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:34.544726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50531890-346b-450e-ab7b-fb57c0f3068d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:34.546204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50531890-346b-450e-ab7b-fb57c0f3068d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:34.567138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 512/1017] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:35.335235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858435-b745-44ce-bd92-3f14ba3da9a9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:35.335751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858435-b745-44ce-bd92-3f14ba3da9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:35.335831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858435-b745-44ce-bd92-3f14ba3da9a9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:35.337203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 506/1018] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:35.342825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a54a9-8791-4c50-b157-7534858fd2fe None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:35.343305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a54a9-8791-4c50-b157-7534858fd2fe None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:35.343385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a54a9-8791-4c50-b157-7534858fd2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:35.360713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-0e5a54a9-8791-4c50-b157-7534858fd2fe None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:35.361928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0e5a54a9-8791-4c50-b157-7534858fd2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:35.439302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 513/1019] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:35.461875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858435-b745-44ce-bd92-3f14ba3da9a9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:35.537374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:35.577098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858435-b745-44ce-bd92-3f14ba3da9a9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:35.612267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edf85f-3eae-4077-bb8f-41945cc2246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:35.612960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf85f-3eae-4077-bb8f-41945cc2246d None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:35.613265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf85f-3eae-4077-bb8f-41945cc2246d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:35.613538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf85f-3eae-4077-bb8f-41945cc2246d None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:35.614286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edf85f-3eae-4077-bb8f-41945cc2246d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:35.615694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edf85f-3eae-4077-bb8f-41945cc2246d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:35.637308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 507/1020] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:01:35 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:36.052832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215aae-3327-4f90-9d6a-1c7785cd9a51 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.053126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215aae-3327-4f90-9d6a-1c7785cd9a51 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.053534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215aae-3327-4f90-9d6a-1c7785cd9a51 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.055163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 514/1021] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:36.060296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.060686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.060931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.078230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:36.079416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:36.157388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 508/1022] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:36.180451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9215aae-3327-4f90-9d6a-1c7785cd9a51 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:36.287084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:36.303851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9215aae-3327-4f90-9d6a-1c7785cd9a51 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:36.342142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf7a2c-04de-4062-a4c8-56347d10f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:36.343051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7a2c-04de-4062-a4c8-56347d10f0cd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.343598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7a2c-04de-4062-a4c8-56347d10f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.343598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7a2c-04de-4062-a4c8-56347d10f0cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.344775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf7a2c-04de-4062-a4c8-56347d10f0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:36.346261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf7a2c-04de-4062-a4c8-56347d10f0cd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:36.352572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 515/1023] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:36.354328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:36.412140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:36.459273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338d48-315f-4ddf-bd3f-3d9677ca2532 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:36.493588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dd5c4-b6bc-4786-8560-ffcbcb56ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:36.494263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dd5c4-b6bc-4786-8560-ffcbcb56ce5f None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.494537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dd5c4-b6bc-4786-8560-ffcbcb56ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.494805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dd5c4-b6bc-4786-8560-ffcbcb56ce5f None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.495521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dd5c4-b6bc-4786-8560-ffcbcb56ce5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:36.496972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dd5c4-b6bc-4786-8560-ffcbcb56ce5f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:36.525264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 509/1024] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:01:36 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:36.712902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812134bc-23e1-4b09-98f1-0cc63c5668b5 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.713085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812134bc-23e1-4b09-98f1-0cc63c5668b5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.713396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812134bc-23e1-4b09-98f1-0cc63c5668b5 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.714839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 516/1025] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:36.720673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.720961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.721256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.740503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:36.741742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:36.814514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 510/1026] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:36.838594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812134bc-23e1-4b09-98f1-0cc63c5668b5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:36.945474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812134bc-23e1-4b09-98f1-0cc63c5668b5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:36.980041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:36.980777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:36.981052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:36.981348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:36.991478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:36.999646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:37.000604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:37.006934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 517/1027] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 20 09:01:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:37.008993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.054692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:37.121084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db9c0c-6a1e-4e8b-bde7-b98679a1a1d1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:37.158055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:37.158735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.159013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.159286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.160044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:37.160348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:37.161846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:37.170642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 511/1028] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:37.176402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.203022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:37.281495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f878a-a83e-4fc6-a990-46365a2c10b6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:37.322604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:37.323404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.323678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.323943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.335357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:37.336872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:37.354586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:37.360968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:37.361920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:37.361920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:37.361920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:37.361920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:37.361920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 518/1029] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:37.362210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.467481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a581dd7-87da-47d0-a229-348476649967 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:37.469018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:37.513552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:37.514466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.514745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.515019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.515743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:37.516057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:37.517471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438046-3b48-42ba-a189-11be9d1c272d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:37.534708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 512/1030] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:37.536200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.619068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:37.645636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ff5c-3ec0-412b-a819-b95b6a006e1f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:37.681372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:37.682212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.682490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.682761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.687921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18ada-e761-4828-916f-dd663d702999 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.688213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18ada-e761-4828-916f-dd663d702999 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.688487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18ada-e761-4828-916f-dd663d702999 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.690099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 513/1031] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:01:37.694710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:37.695530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.695815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.696088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.696271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:37.713404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:37.714483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:37.715425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:37.716495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:37.716495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:37.717886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 519/1032] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:37.721826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.801540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 514/1033] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:37.816011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.825748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211871b0-7ea5-40e0-b6e3-4720ed3f20a9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:37.862946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:37.864037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.864356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.864636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.865509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:37.865820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:37.867242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:37.868921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:37.886878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 520/1034] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:37.892946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:37.914580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:37.925784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61991c-2408-487b-81b7-dc0547d12ed8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:37.969327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:37.970155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:37.970431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:37.970702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:37.971378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:37.972842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:37.985205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:37.986250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:37.987082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:37.991578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 515/1035] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:37.992410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.003236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a05827-c784-43ad-9182-663fe871c2b5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.042429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.043093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.043371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.043640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.097364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857119-8c60-46a1-b259-2391624457e1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.105255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.116915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.118748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.137003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.137956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.138237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.139028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.140033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] RBAC: Adding query filter params (name=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:38.140343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.142265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.154246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 516/1036] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:38.156325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.183508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.227000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 521/1037] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:01:38.233301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.275537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a6feb-afa9-4419-8ae4-49b7943e7036 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.317579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.318260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.318531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.318813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.319516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:38.319812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.321172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.327324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 517/1038] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:38.333279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.343072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.354117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2576e2-8f38-4a72-93b9-ae106e98e5ab None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.388520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.389369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.389644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.389907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.400192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.401669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:38.419862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:38.421386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:38.422435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:38.422435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:38.422435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:38.422435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:38.422435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 522/1039] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:38.426916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.429167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.447849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39338f9-18c2-4601-9c85-a01d8c3178c5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.484070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.484737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.485013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.485308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.486093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] RBAC: Adding query filter params (interface=public, service_id=87898698d6e74ec68c9872ef2962ba83, region_id=RegionOne) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:38.486399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.487770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.493097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 518/1040] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/endpoints?service_id=87898698d6e74ec68c9872ef2962ba83&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:38.498630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.531747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21433f96-93de-4813-92f3-de9e6bcb1ceb None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.570438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.571005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.571273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.571536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.572261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:38.572573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.573976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.586431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 523/1041] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:38.591962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.596540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.614013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27c5e-b0b6-4f7e-a0a6-f0f54e54e59e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.650011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72862e7-b17d-4079-b6ab-8f560a01f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.650674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72862e7-b17d-4079-b6ab-8f560a01f108 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.650948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72862e7-b17d-4079-b6ab-8f560a01f108 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.651215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72862e7-b17d-4079-b6ab-8f560a01f108 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.651913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72862e7-b17d-4079-b6ab-8f560a01f108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.653319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72862e7-b17d-4079-b6ab-8f560a01f108 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.660571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 519/1042] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:01:38.662158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866c16-ea58-4511-a874-3cb493dfebdb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.662428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866c16-ea58-4511-a874-3cb493dfebdb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.662718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866c16-ea58-4511-a874-3cb493dfebdb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.664125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 520/1043] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:38.670066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.670399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.670613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.689935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:38.691171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:38.699945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.704846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09329-7fbe-48da-ba91-5ac72f82196d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.741770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.742590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.742865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.743133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.751947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.753550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:38.769336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:38.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:38.771206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:38.775695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 524/1044] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:38.781503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 521/1045] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:38.781689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.799801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.850176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:38.898005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acb451-3a15-417b-aa6f-d2c07322512b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.904530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcdf1b-b6c9-4b9c-856a-878d63439895 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:38.933274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.933940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.934214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.934481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.935256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:38.935612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:38.937051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:38.942128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:38.942931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:38.943203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:38.943468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:38.954056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 525/1046] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:38.955689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.959268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:38.966999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:38.968191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:38.969122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 522/1047] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:38.974495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:38.978645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:39.069075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874c047-d2a8-4600-a6ce-3d12bfac1eaa None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:39.084757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51d80-ba02-445d-a835-1f8fd00ae514 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:39.093324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:39.105912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:39.107007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:39.107289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:39.107921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:39.109098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] RBAC: Adding query filter params (role.id=4abcfbe97c5f4d9d9c52db3f000af8a4, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=3e99c32d943148cd8625c3ebd6c11887) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:39.109445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:39.110918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:39.116843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 526/1048] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/role_assignments?user.id=3e99c32d943148cd8625c3ebd6c11887&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=4abcfbe97c5f4d9d9c52db3f000af8a4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:39.121082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:39.121821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:39.122101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:39.122370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:39.123200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:39.123501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:39.124928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:39.137591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 523/1049] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:39.141444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:39.256975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2bfe-8200-43a6-a29e-fd23aee5edf6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:39.296200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:39.297599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:39.297599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:39.297746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] PATH_INFO: `/v3/users/71689f555ce74991965bc027d543d143` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:39.312920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=71689f555ce74991965bc027d543d143)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:39.314398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:39.320657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 527/1050] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:39 2022] GET /identity/v3/users/71689f555ce74991965bc027d543d143 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:39.322230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:39.387095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:39.427629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cbed2-792a-49fd-9538-cb5593e76e75 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:39.466589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:39.467425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:39.467689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:39.467949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:39.537930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:39.539305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:39.610698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:39.651239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 524/1051] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:39.657179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:39.706814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:39.766515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265286b-1e55-451e-9b07-e686e451a1f9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:39.804729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69225048-0310-41bc-9a82-032ebf613e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:39.805645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69225048-0310-41bc-9a82-032ebf613e02 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:39.805920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69225048-0310-41bc-9a82-032ebf613e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:39.806188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69225048-0310-41bc-9a82-032ebf613e02 None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:39.807407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69225048-0310-41bc-9a82-032ebf613e02 None admin] RBAC: Authorizing `identity:get_project(project_id=b6bfc307ae974050881edd4e6b656a88)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:39.808864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69225048-0310-41bc-9a82-032ebf613e02 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:39.810958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 528/1052] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:01:39 2022] GET /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:39.817047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:39.926877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4969-90c7-4082-8d34-d880a8661073 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:39.966201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:39.967093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:39.967464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:39.967936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:39.968781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=b6bfc307ae974050881edd4e6b656a88, user.id=71689f555ce74991965bc027d543d143) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:39.969090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:39.970578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271945-fcc8-4b62-8885-88ee1c673abd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:39.976389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 525/1053] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:39 2022] GET /identity/v3/role_assignments?user.id=71689f555ce74991965bc027d543d143&scope.project.id=b6bfc307ae974050881edd4e6b656a88&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:40.736423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281e9aa-43ad-4db7-acec-656e9ecd98fc None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:40.736991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281e9aa-43ad-4db7-acec-656e9ecd98fc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:40.736991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281e9aa-43ad-4db7-acec-656e9ecd98fc None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:40.738422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 529/1054] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:40.744163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:40.744581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:40.744756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:40.762533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:40.763757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:40.788540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:40.838193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 526/1055] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:40.862194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281e9aa-43ad-4db7-acec-656e9ecd98fc None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:40.969959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281e9aa-43ad-4db7-acec-656e9ecd98fc None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:40.984579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:41.006947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.007668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.007940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.008262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] PATH_INFO: `/v3/services/image` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.008913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:41.010343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-2f4bda0f-8075-4998-a024-cbb81033ea7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:41.022444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:41.023447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:01:41.024315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:41.028838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 530/1056] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 20 09:01:40 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:41.030321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.135684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803bac7-eae0-4cc6-9f05-0c3d079e1309 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:41.170047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.170758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.171029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.171473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.172173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] RBAC: Adding query filter params (name=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:41.172472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:41.173876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:41.179223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 527/1057] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:41.184947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.185533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fb33c-5b83-42e9-9d21-6000d009da47 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.185827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fb33c-5b83-42e9-9d21-6000d009da47 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.186097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fb33c-5b83-42e9-9d21-6000d009da47 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.187781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 531/1058] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:41.193009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.193341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.193585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.210709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:41.210887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:41.211971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:41.282817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 532/1059] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:41.290872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf05a-1f69-489f-884a-f6a6e37aae4f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:41.305874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.333953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.334624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.334899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.335163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.335858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] RBAC: Adding query filter params (type=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:41.336159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:41.337572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:41.343486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 528/1060] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:41.348793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.413947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35a60-6038-464a-99d5-3fcdff0b24eb None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:41.425119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:41.446014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:41.453822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.454662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.454933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.455207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.462869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aea37-da17-44ad-bf6f-ab8930142d75 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:41.467068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:41.476353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:41.477327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:41.478533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 533/1061] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 20 09:01:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:41.484003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.500331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.500996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.501298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.501576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.502308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:41.503697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:41.524600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 529/1062] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:01:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:01:41.608231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806fcd4-f071-4fd2-a506-ec5e6dbebe5f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:41.657087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.657824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.658070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.658358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.659115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:41.659415 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:41.660872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:41.670899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 534/1063] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:01:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:41.676730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.783204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c779a-9483-47fd-a347-f8fa833b233b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:41.819001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:41.819796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:41.820070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:41.820334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:41.831803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:41.833279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:41.835347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-192dfdf3-4491-455a-af57-ccbb32ea71d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:41.853736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:41.854707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:41.855598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:41.855598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:41.855598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:41.855598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:41.855598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 530/1064] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:41.862947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:41.896304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:41.979162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4a75-9b53-45c3-ae6a-64237bed5bec None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.008873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a260-eb11-4560-b419-5d10f16db921 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.009318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a260-eb11-4560-b419-5d10f16db921 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.009427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a260-eb11-4560-b419-5d10f16db921 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.011103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 531/1065] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:42.014593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.015308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.015585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.015856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.016157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.016437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.016605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:42.016700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.016854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.018264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.032465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 535/1066] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:42.034525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:42.035786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:42.038391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.112889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 532/1067] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:42.135123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.136069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.156553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcabe1f-f004-40f6-855c-a14e326b7171 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.195967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.196773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.197053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.197365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.205181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.206841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:42.223576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:42.224593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:42.225563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 536/1068] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:42.230949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.244441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af691c4b-ffac-4a0a-b162-6b803f96a21e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.275459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.292663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.293660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.294053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.294649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.311358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:42.319210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:42.320149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:42.320990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 533/1069] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:42.326645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.347268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c84e8-4242-4ebe-abb7-867bc40637bf None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.383114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.383792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.384071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.384344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.385275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:42.385516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.386945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.404571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 537/1070] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:42.410301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.414096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.438037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6827d-37df-44c8-ab51-0928d1aab9c5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.473554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.474436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.474857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.475266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.476179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:42.476624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.478610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.487174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 534/1071] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:42.492905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.518162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eaea-6167-4420-892a-e3e59210f877 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.540679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.554657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.555461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.555741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.556014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.567185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.568647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:42.586425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:42.587351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:42.588233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:42.588233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:42.588233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:42.588233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:42.593368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 538/1072] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:42.594142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.600767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269cc-8aef-4f56-9831-3bf7f368dd7e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.637585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.638390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.638722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.639000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] PATH_INFO: `/v3/users/71689f555ce74991965bc027d543d143` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.640215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] RBAC: Authorizing `identity:get_user(user_id=71689f555ce74991965bc027d543d143)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.641701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.643372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 535/1073] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/users/71689f555ce74991965bc027d543d143 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:42.650252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.653553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.703831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287acfb6-fc22-4e4b-a92a-8a8e6ad8b736 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.740149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.741336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.741855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.742340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.743257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:42.743770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.745243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.755652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3d5f-359d-4e82-9eb2-c2f9052dec90 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.758036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 539/1074] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:42.763833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.771698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.795400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.796279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.796556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.796821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.798097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] RBAC: Authorizing `identity:get_project(project_id=b6bfc307ae974050881edd4e6b656a88)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.799533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.801530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 536/1075] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:42.807149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.874388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1269-79cf-42cf-95fc-4786dba3d53b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.891931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:42.910810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.911620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.911895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.912163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.914316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f042-10b7-4024-a26c-eb1dc7b51018 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:42.919034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.920540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:42.934436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:42.935310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:42.936313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 540/1076] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:42.941628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:42.953346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:42.954552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:42.954832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:42.955252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88/users/71689f555ce74991965bc027d543d143/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:42.957240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] RBAC: Authorizing `identity:create_grant(project_id=b6bfc307ae974050881edd4e6b656a88, user_id=71689f555ce74991965bc027d543d143, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:42.958674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:42.973940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 537/1077] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:42 2022] PUT /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88/users/71689f555ce74991965bc027d543d143/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:01:43.057462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086894c4-2f44-4525-bb2c-09cf915d84fd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:43.096406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:43.097089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:43.097405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:43.097677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:43.098507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:43.098812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:43.100292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6756-b42f-4f91-8579-cee701323782 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:43.119468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 541/1078] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:43.120845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:43.171880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:43.231802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3607-e8e3-41e1-978d-3fa91dfc9b1e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:43.266542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ac2c3-84a8-4cdd-a642-10c44f0e77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:43.267464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac2c3-84a8-4cdd-a642-10c44f0e77c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:43.267735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac2c3-84a8-4cdd-a642-10c44f0e77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:43.268003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac2c3-84a8-4cdd-a642-10c44f0e77c6 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/3e99c32d943148cd8625c3ebd6c11887/roles/4abcfbe97c5f4d9d9c52db3f000af8a4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:43.270284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac2c3-84a8-4cdd-a642-10c44f0e77c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=3e99c32d943148cd8625c3ebd6c11887, role_id=4abcfbe97c5f4d9d9c52db3f000af8a4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:43.271747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac2c3-84a8-4cdd-a642-10c44f0e77c6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:43.286989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 538/1079] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:43 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/3e99c32d943148cd8625c3ebd6c11887/roles/4abcfbe97c5f4d9d9c52db3f000af8a4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:01:43.627621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9559b9-6504-47b0-b99e-2feae78f7ef9 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:43.627964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9559b9-6504-47b0-b99e-2feae78f7ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:43.628239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9559b9-6504-47b0-b99e-2feae78f7ef9 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:43.629541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 542/1080] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:43.635435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:43.635689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:43.635984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:43.653883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:43.655244 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:43.725458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 539/1081] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:43.747965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9559b9-6504-47b0-b99e-2feae78f7ef9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:43.787228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:43.858575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9559b9-6504-47b0-b99e-2feae78f7ef9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:43.892768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:43.893397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:43.893635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:43.893901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:43.961937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:43.963385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:44.003256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:44.073881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 543/1082] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:44.079961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:44.112770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:44.184735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dcbf1-4926-4a0b-bf4d-d28f828cce7b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:44.219410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:44.220201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:44.220472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:44.220738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:44.231208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:44.232836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-871f7f25-5020-49f1-a7f8-d693ada35a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:44.250603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:44.251520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:44.252424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:44.252424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:44.252424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:44.252424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:44.252424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 540/1083] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:44.258817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:44.376343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d138-3de4-4999-a790-c1636477f222 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:44.412493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:44.413169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:44.413477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:44.413749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:44.414481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:44.414785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:44.416171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ccc21-9b70-4d76-b28a-f84bbb150b66 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:44.418817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:44.430923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 544/1084] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:45.026930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc15bf-7af9-4d82-b63a-1c24a1cb60a6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.027159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc15bf-7af9-4d82-b63a-1c24a1cb60a6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.027461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc15bf-7af9-4d82-b63a-1c24a1cb60a6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.029052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 541/1085] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:45.034713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.035205 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.035294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.054669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:45.055904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:45.128150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 545/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:45.151747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc15bf-7af9-4d82-b63a-1c24a1cb60a6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.240111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:45.258137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc15bf-7af9-4d82-b63a-1c24a1cb60a6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.292460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4370-6187-483e-b626-a8e16b24267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.293192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4370-6187-483e-b626-a8e16b24267f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.293489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4370-6187-483e-b626-a8e16b24267f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.293763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4370-6187-483e-b626-a8e16b24267f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.309859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc4370-6187-483e-b626-a8e16b24267f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dcbc4370-6187-483e-b626-a8e16b24267f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:45.318200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:45.319207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:45.320059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 542/1087] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:45.326006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.354878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09c01-1a68-42c3-a599-3658157cf1dc None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.355131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09c01-1a68-42c3-a599-3658157cf1dc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.355565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09c01-1a68-42c3-a599-3658157cf1dc None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.357800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 543/1088] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:45.364528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.365050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.365374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.384924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:45.386183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:45.440763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3a0ed-b4c9-4c53-8d78-da1344057b89 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.455046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 544/1089] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:45.465546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:45.474464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.475137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.475413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.475684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.476458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:45.476763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:45.478512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:45.478912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.487185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 546/1090] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:45.492825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.552847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:45.579659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf908a-37d6-48ac-a323-48e52ce5eaf1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.594106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d8443-aa7a-4d2e-b9a1-c9f8a431064a None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.615068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.615902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.616233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.616505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.626713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:01:45.627815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.628800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.629070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.629371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] PATH_INFO: `/v3/users/71689f555ce74991965bc027d543d143` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.630545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] RBAC: Authorizing `identity:get_user(user_id=71689f555ce74991965bc027d543d143)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:45.631976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:45.633686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 547/1091] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/users/71689f555ce74991965bc027d543d143 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:01:45.634852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:45.635884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:45.636772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 545/1092] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:01:45.639957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.643645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.706828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:45.746634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32c250-d794-460f-b84a-c4ef09226473 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.751119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ebc9-a2da-41b3-a191-57bba42f26f8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.783348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.784043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.784317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.784585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.785406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:45.785690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:45.787079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:45.788452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:45.790995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.791689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.791966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.792239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.796727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 546/1093] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:45.802512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.862523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:45.863895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:45.903382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaee9e-baf5-4215-a458-8e4bf91c7b0d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:45.918047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:45.938664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:45.939468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:45.939747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:45.940018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:45.950630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:45.952360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:45.964395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 548/1094] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:45.969789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:45.970699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:45.971589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:45.971589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:45.971589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:45.971589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:45.971589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 547/1095] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:45.971874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:45.976923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:46.027706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:46.080641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365e759-2b0c-4713-ab82-1fc05ab01ae3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.081828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359454-c33d-4b8d-b57c-0e4d665a44a5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.114996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.115648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.115925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.116198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.116928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:46.117222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.117338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.118191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.118473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.118664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.118761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.119903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b6bfc307ae974050881edd4e6b656a88)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.121364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.123197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 549/1096] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:46.129340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:46.132235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 548/1097] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:46.137864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:46.154293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:46.230338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e660eed-c4f2-45c3-b4c9-5f1a01b178c8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.236618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd416-ac8d-4a10-a498-2c3a0f75f657 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.246357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:46.264279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.264937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.265206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.265501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.266319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=b6bfc307ae974050881edd4e6b656a88, user.id=71689f555ce74991965bc027d543d143) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:46.266624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.268050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.271666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.272458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.272734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.273001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.273939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 550/1098] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:46 2022] GET /identity/v3/role_assignments?user.id=71689f555ce74991965bc027d543d143&scope.project.id=b6bfc307ae974050881edd4e6b656a88&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:01:46.280671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.282184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:01:46.299272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:46.300347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:01:46.301844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 549/1099] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 20 09:01:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:46.306920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:46.407977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:46.422519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d6ef5-7a6c-404d-9889-bd3decc3a960 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.457602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.458276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.458535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.458800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.459647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:46.459956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.461405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.479923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 551/1100] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 20 09:01:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:46.486331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:46.589447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365494-f7b1-42bb-b77d-41c6c35fa092 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.626084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.626741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.627015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.627282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.663270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:46.698107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.699573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.801051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 550/1101] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:01:46.807029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:46.910131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda6db-6b69-4ac7-8f57-dcb17c68bd0e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:46.946118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:46.946827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:46.947102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:46.947366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:46.958051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:46.959498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:46.966355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:01:46.978654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:46.979585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:46.980697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:01:46.980697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:01:46.980697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:01:46.980697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:46.980697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 552/1102] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:46.985937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:47.052699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:47.088784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb5a9-d8af-497b-b69c-086f252e2174 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:47.122401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:47.123095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:47.123373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:47.123693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:47.124471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:47.124773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:47.126223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:47.138224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 551/1103] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:47.144185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:47.246698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839dbd8-0e73-43aa-b4c7-29ec36b259e0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:47.281933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:47.282731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:47.283003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:47.283268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:47.290052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:47.291518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:01:47.306100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:01:47.306990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:01:47.307873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 553/1104] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:01:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:01:47.313862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:47.419680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78bd04-89cf-487a-bde5-c7d799ed3c57 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:47.448434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:47.457907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:47.458574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:47.458854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:47.459124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:47.459903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:47.460211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:47.461668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a44d08-ec91-44f9-a58b-78a5376215f4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:47.473829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 552/1105] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:01:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:47.480483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:47.541938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:47.584374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73534b93-d189-4e2d-bbb4-28117dcaa8f0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:47.619867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:47.620530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:47.620808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:47.621080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:47.621935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] RBAC: Adding query filter params (role.id=4abcfbe97c5f4d9d9c52db3f000af8a4, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=3e99c32d943148cd8625c3ebd6c11887) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:47.622245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:47.624071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aecb6-c71c-4210-b4dd-0b41c545b3ce None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:47.630154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 554/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:47 2022] GET /identity/v3/role_assignments?user.id=3e99c32d943148cd8625c3ebd6c11887&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=4abcfbe97c5f4d9d9c52db3f000af8a4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:48.334434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd249cf-00c4-48ff-8f36-4c0e867d6c10 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:48.334981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd249cf-00c4-48ff-8f36-4c0e867d6c10 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:48.334981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd249cf-00c4-48ff-8f36-4c0e867d6c10 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:48.336481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 553/1107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:48.341988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:48.342653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:48.342653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:48.359998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:48.361158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:48.431238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 555/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:48.455205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd249cf-00c4-48ff-8f36-4c0e867d6c10 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:48.560815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd249cf-00c4-48ff-8f36-4c0e867d6c10 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:48.596670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988ee3e-39ca-424f-8657-53a824516bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:48.597480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988ee3e-39ca-424f-8657-53a824516bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:48.597754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988ee3e-39ca-424f-8657-53a824516bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:48.598019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988ee3e-39ca-424f-8657-53a824516bd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:48.599309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988ee3e-39ca-424f-8657-53a824516bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:48.600744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988ee3e-39ca-424f-8657-53a824516bd1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:48.602395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 554/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:01:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:48.609821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:48.679068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:48.729681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9dc83-556b-479b-a020-607e73113950 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:48.765181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0f65-ee20-449a-8d71-cf4dde02a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:48.765874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0f65-ee20-449a-8d71-cf4dde02a98a None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:48.766147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0f65-ee20-449a-8d71-cf4dde02a98a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:48.766413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0f65-ee20-449a-8d71-cf4dde02a98a None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:48.767141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0f65-ee20-449a-8d71-cf4dde02a98a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:48.768568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0f65-ee20-449a-8d71-cf4dde02a98a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:48.791023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 556/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:01:48 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:01:50.881310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb02b1-80ab-4368-86af-81a900365e04 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:50.882269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb02b1-80ab-4368-86af-81a900365e04 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:50.882269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb02b1-80ab-4368-86af-81a900365e04 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:50.884384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 555/1111] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:50.891702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:50.892173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:50.892269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:50.910945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:50.912122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:50.995930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 557/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:01:51.021281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb02b1-80ab-4368-86af-81a900365e04 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:51.082394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:51.134863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb02b1-80ab-4368-86af-81a900365e04 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:51.173019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245176e-e207-4945-b323-e8907255d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:51.173919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245176e-e207-4945-b323-e8907255d19c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:51.174202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245176e-e207-4945-b323-e8907255d19c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:51.174454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245176e-e207-4945-b323-e8907255d19c None admin] PATH_INFO: `/v3/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:51.176024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245176e-e207-4945-b323-e8907255d19c None admin] RBAC: Authorizing `identity:get_role(role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:51.177474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245176e-e207-4945-b323-e8907255d19c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:51.178922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 556/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:51 2022] GET /identity/v3/roles/1efc231eee0048ba834a4bd3d88a430c => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:51.188271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:51.241633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:51.305202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c1d9c-dee4-44d7-b1fc-9147d028e5f0 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:51.344546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:51.345475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:51.345752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:51.346029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] PATH_INFO: `/v3/users/d2fe7c9d7b264e30a818a6e587e5ce2c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:51.360786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=d2fe7c9d7b264e30a818a6e587e5ce2c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:51.362302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:51.364357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 558/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:51 2022] GET /identity/v3/users/d2fe7c9d7b264e30a818a6e587e5ce2c => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:51.370786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245176e-e207-4945-b323-e8907255d19c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:51.485469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245176e-e207-4945-b323-e8907255d19c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:51.509023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:51.521498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:51.522137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:51.522411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:51.522673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:51.591709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:51.593211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:51.716957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 557/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:01:51.726280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:51.842957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:51.852295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c23b9c-d228-44cc-ab34-977683116ce6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:51.896445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c55f7-6770-4900-be0f-0aa2f8901393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:51.897349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c55f7-6770-4900-be0f-0aa2f8901393 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:51.897621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c55f7-6770-4900-be0f-0aa2f8901393 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:51.897888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c55f7-6770-4900-be0f-0aa2f8901393 None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:51.899141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c55f7-6770-4900-be0f-0aa2f8901393 None admin] RBAC: Authorizing `identity:get_project(project_id=b6bfc307ae974050881edd4e6b656a88)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:51.900585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c55f7-6770-4900-be0f-0aa2f8901393 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:51.902356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 559/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:01:51 2022] GET /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:51.911843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:51.946548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:52.043118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46875fb-c5f7-4ea8-9037-3029e39a1513 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:52.079124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:52.079767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:52.080043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:52.080311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:52.081135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] RBAC: Adding query filter params (role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=b6bfc307ae974050881edd4e6b656a88, user.id=d2fe7c9d7b264e30a818a6e587e5ce2c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:52.081450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:52.082915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a00f71-47bd-4ec8-a5bf-a7ca71b40f84 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:52.088490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 558/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:51 2022] GET /identity/v3/role_assignments?user.id=d2fe7c9d7b264e30a818a6e587e5ce2c&scope.project.id=b6bfc307ae974050881edd4e6b656a88&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:54.116777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1ca81-6a7c-49e4-a79d-5eb1df1d7bf3 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:54.117746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1ca81-6a7c-49e4-a79d-5eb1df1d7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:54.117746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1ca81-6a7c-49e4-a79d-5eb1df1d7bf3 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:54.119936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 560/1118] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:54.126453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:54.126925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:54.127201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:54.146155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:54.147372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:54.221714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 559/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:54.245585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1ca81-6a7c-49e4-a79d-5eb1df1d7bf3 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:54.362451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1ca81-6a7c-49e4-a79d-5eb1df1d7bf3 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:54.397677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:54.398468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:54.398736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:54.399004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] PATH_INFO: `/v3/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:54.400578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] RBAC: Authorizing `identity:get_role(role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:54.402001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:54.403400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 561/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:54 2022] GET /identity/v3/roles/1efc231eee0048ba834a4bd3d88a430c => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:54.409823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:54.429156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:54.515941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f92088-191d-4bb2-8f85-9c6e0651c46f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:54.551458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:54.552327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:54.552601 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:54.552868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] PATH_INFO: `/v3/users/d2fe7c9d7b264e30a818a6e587e5ce2c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:54.554134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] RBAC: Authorizing `identity:get_user(user_id=d2fe7c9d7b264e30a818a6e587e5ce2c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:54.555571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:54.557197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 560/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:54 2022] GET /identity/v3/users/d2fe7c9d7b264e30a818a6e587e5ce2c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:54.563361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:54.599739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:54.672510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6532-2047-4b91-8825-0a31e050933b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:54.710795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c3d2a-af68-4b56-abab-18632646dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:54.711643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c3d2a-af68-4b56-abab-18632646dabc None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:54.711914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c3d2a-af68-4b56-abab-18632646dabc None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:54.712182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c3d2a-af68-4b56-abab-18632646dabc None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:54.713518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c3d2a-af68-4b56-abab-18632646dabc None admin] RBAC: Authorizing `identity:get_project(project_id=b6bfc307ae974050881edd4e6b656a88)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:54.714954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c3d2a-af68-4b56-abab-18632646dabc None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:54.716766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 562/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:01:54 2022] GET /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:54.723224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:54.815252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:54.831540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d62dc-1952-4652-9242-2a4697dc6d41 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:54.871042 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49c30f-49c2-49cd-9905-3089077162a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:54.871929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49c30f-49c2-49cd-9905-3089077162a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:54.872206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49c30f-49c2-49cd-9905-3089077162a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:54.872481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49c30f-49c2-49cd-9905-3089077162a6 None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88/users/d2fe7c9d7b264e30a818a6e587e5ce2c/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:54.875034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49c30f-49c2-49cd-9905-3089077162a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6bfc307ae974050881edd4e6b656a88, user_id=d2fe7c9d7b264e30a818a6e587e5ce2c, role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:54.876485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49c30f-49c2-49cd-9905-3089077162a6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:54.891753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 561/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:01:54 2022] PUT /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88/users/d2fe7c9d7b264e30a818a6e587e5ce2c/roles/1efc231eee0048ba834a4bd3d88a430c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:01:56.990929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cf55-a8e5-4710-adf2-a7b09a6dfc25 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:56.991573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cf55-a8e5-4710-adf2-a7b09a6dfc25 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:56.991573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cf55-a8e5-4710-adf2-a7b09a6dfc25 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:56.992950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 563/1124] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:01:56.999287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:56.999792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:56.999792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:57.019972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:01:57.021182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:01:57.118817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 562/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:01:57.149359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cf55-a8e5-4710-adf2-a7b09a6dfc25 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:57.286049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:57.292184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cf55-a8e5-4710-adf2-a7b09a6dfc25 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:57.344150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:57.345022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:57.345327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:57.345605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] PATH_INFO: `/v3/roles/1efc231eee0048ba834a4bd3d88a430c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:57.347367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] RBAC: Authorizing `identity:get_role(role_id=1efc231eee0048ba834a4bd3d88a430c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:57.348771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:57.350240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 564/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:57 2022] GET /identity/v3/roles/1efc231eee0048ba834a4bd3d88a430c => generated 223 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:57.360818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:57.453460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:57.478362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfd14d-f20d-4d98-846a-ef4ec4cc7d9f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:57.516090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:57.516959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:57.517262 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:57.517533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] PATH_INFO: `/v3/users/d2fe7c9d7b264e30a818a6e587e5ce2c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:57.518751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] RBAC: Authorizing `identity:get_user(user_id=d2fe7c9d7b264e30a818a6e587e5ce2c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:57.520207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:57.521897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 563/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:01:57 2022] GET /identity/v3/users/d2fe7c9d7b264e30a818a6e587e5ce2c => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:57.531252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:57.649992 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb236-9c7c-442f-9f6a-7098ad443104 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:57.698322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:57.698976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:57.699251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:57.699519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:57.735357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:57.771491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:57.774210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:57.895682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 565/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:01:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:01:57.901954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:58.016794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5215701-163e-4f1b-884a-deb042fb7f6c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:58.053203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28a72-6d27-4ac2-aa3b-f51162f5e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:58.054094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28a72-6d27-4ac2-aa3b-f51162f5e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:58.054373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28a72-6d27-4ac2-aa3b-f51162f5e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:58.054648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28a72-6d27-4ac2-aa3b-f51162f5e0b1 None admin] PATH_INFO: `/v3/projects/b6bfc307ae974050881edd4e6b656a88` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:58.055954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28a72-6d27-4ac2-aa3b-f51162f5e0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=b6bfc307ae974050881edd4e6b656a88)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:58.057462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28a72-6d27-4ac2-aa3b-f51162f5e0b1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:58.059189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 564/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:01:57 2022] GET /identity/v3/projects/b6bfc307ae974050881edd4e6b656a88 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:01:58.067302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:01:58.136209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:01:58.176549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4d34-cd85-487e-8e7e-8fc3940fb7a3 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:01:58.212426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:01:58.213079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:01:58.213383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:01:58.213661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:01:58.214492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] RBAC: Adding query filter params (role.id=1efc231eee0048ba834a4bd3d88a430c, scope.project.id=b6bfc307ae974050881edd4e6b656a88, user.id=d2fe7c9d7b264e30a818a6e587e5ce2c) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:01:58.214804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:01:58.216236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0bc23-8d3e-4875-8d27-925c62b061a5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:01:58.223168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 566/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:01:58 2022] GET /identity/v3/role_assignments?user.id=d2fe7c9d7b264e30a818a6e587e5ce2c&scope.project.id=b6bfc307ae974050881edd4e6b656a88&role.id=1efc231eee0048ba834a4bd3d88a430c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:00.278636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4daf-6ba2-4a64-aa17-8a89a303359e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:00.279638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4daf-6ba2-4a64-aa17-8a89a303359e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:00.279638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4daf-6ba2-4a64-aa17-8a89a303359e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:00.282062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 565/1131] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:00.290976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:00.291674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:00.291822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:00.319540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:00.320723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:00.400042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 567/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:00.424256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4daf-6ba2-4a64-aa17-8a89a303359e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:00.451257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:00.551475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4daf-6ba2-4a64-aa17-8a89a303359e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:00.590147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad6e1-6e70-4aff-ac59-881727e4ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:00.591262 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad6e1-6e70-4aff-ac59-881727e4ce7a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:00.591820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad6e1-6e70-4aff-ac59-881727e4ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:00.592383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad6e1-6e70-4aff-ac59-881727e4ce7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:00.594353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad6e1-6e70-4aff-ac59-881727e4ce7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:00.596589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad6e1-6e70-4aff-ac59-881727e4ce7a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:00.599049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 566/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:00.608007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:00.675494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:00.716744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa23d-0c1c-45a8-afb5-eda8049dd558 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:00.755240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d662a2-f90a-4b8b-82c0-77fd1921ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:00.755894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d662a2-f90a-4b8b-82c0-77fd1921ce23 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:00.756158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d662a2-f90a-4b8b-82c0-77fd1921ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:00.756425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d662a2-f90a-4b8b-82c0-77fd1921ce23 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:00.757119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d662a2-f90a-4b8b-82c0-77fd1921ce23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:00.758593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d662a2-f90a-4b8b-82c0-77fd1921ce23 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:00.791161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 568/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:02:00 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:02:02.896614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ecb91-89f9-4780-a2db-d1da52c7bf97 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:02.897183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ecb91-89f9-4780-a2db-d1da52c7bf97 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:02.897183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ecb91-89f9-4780-a2db-d1da52c7bf97 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:02.898571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 567/1135] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:02.905501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:02.906229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:02.906420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:02.930025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:02.931222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:03.008183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 569/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:03.041149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ecb91-89f9-4780-a2db-d1da52c7bf97 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:03.133943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:03.163540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ecb91-89f9-4780-a2db-d1da52c7bf97 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:03.198876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c27f6-e685-425c-bd5f-143a44acb322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:03.199698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c27f6-e685-425c-bd5f-143a44acb322 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:03.199965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c27f6-e685-425c-bd5f-143a44acb322 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:03.200224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c27f6-e685-425c-bd5f-143a44acb322 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:03.201590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c27f6-e685-425c-bd5f-143a44acb322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:03.203035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c27f6-e685-425c-bd5f-143a44acb322 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:03.204667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 568/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:03.214264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:03.282819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:03.347426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde90d0-ec43-4cbc-a73f-78ae4a3c3860 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:03.383109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f162a-2953-4eb2-b219-f6f48963e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:03.383765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f162a-2953-4eb2-b219-f6f48963e9bd None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:03.384040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f162a-2953-4eb2-b219-f6f48963e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:03.384283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f162a-2953-4eb2-b219-f6f48963e9bd None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:03.384988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f162a-2953-4eb2-b219-f6f48963e9bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:03.386477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f162a-2953-4eb2-b219-f6f48963e9bd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:03.409841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 570/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:02:03 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:02:05.472493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6407b1-7b19-42dc-b530-2cefcf4aa627 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:05.473071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6407b1-7b19-42dc-b530-2cefcf4aa627 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:05.473071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6407b1-7b19-42dc-b530-2cefcf4aa627 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:05.474459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 569/1139] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:05.481155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:05.481904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:05.482168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:05.506289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:05.507478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:05.582932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 571/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:05.617779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6407b1-7b19-42dc-b530-2cefcf4aa627 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:05.735932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6407b1-7b19-42dc-b530-2cefcf4aa627 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:05.771886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:05.772674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:05.772948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:05.773217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:05.784222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:02:05.791843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:05.792970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:02:05.793937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 570/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:05.802361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:05.844722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:05.937587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ca32d-20cb-4258-81b7-1d609bfc9332 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:05.976568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:05.977266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:05.977837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:05.978142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:05.978888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:05.979191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:05.980567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:05.988935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 572/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:05.995088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:06.006945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:06.099419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e9cc-b6b4-4faf-a05b-b98c01fd3704 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:06.137044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:06.137952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:06.138249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:06.138524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] PATH_INFO: `/v3/users/9e16d1e3f1cc4c71a32e10f7d9ddebec` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:06.152237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] RBAC: Authorizing `identity:get_user(user_id=9e16d1e3f1cc4c71a32e10f7d9ddebec)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:06.153784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:06.156121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 571/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:02:05 2022] GET /identity/v3/users/9e16d1e3f1cc4c71a32e10f7d9ddebec => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:06.162254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:06.257935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:06.267661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920f97-cc4f-4cb5-bdc7-71fbfa5e0e6c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:06.314908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:06.315581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:06.315864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:06.316143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:06.385707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:06.387081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:06.483588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:06.493271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 573/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:02:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:02:06.499561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:06.568725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:06.609699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7dee-c89b-4b8a-8080-41f30e5609d9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:06.646721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135afa8-a27a-46cc-87c9-b7f1eebbf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:06.647504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135afa8-a27a-46cc-87c9-b7f1eebbf906 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:06.647771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135afa8-a27a-46cc-87c9-b7f1eebbf906 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:06.648036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135afa8-a27a-46cc-87c9-b7f1eebbf906 None admin] PATH_INFO: `/v3/projects/0cac2711920e47e2bf5e85de94f116b8` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:06.649354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135afa8-a27a-46cc-87c9-b7f1eebbf906 None admin] RBAC: Authorizing `identity:get_project(project_id=0cac2711920e47e2bf5e85de94f116b8)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:06.650788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135afa8-a27a-46cc-87c9-b7f1eebbf906 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:06.652493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 572/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:02:06 2022] GET /identity/v3/projects/0cac2711920e47e2bf5e85de94f116b8 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:06.662515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:06.768754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44302a7-9569-4d88-b18b-dae9f2b89241 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:06.803394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:06.804033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:06.804306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:06.804575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:06.805435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=0cac2711920e47e2bf5e85de94f116b8, user.id=9e16d1e3f1cc4c71a32e10f7d9ddebec) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:06.805741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:06.807165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aed8c6-7114-4386-b051-8899cfd1ae76 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:06.812833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 574/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:02:06 2022] GET /identity/v3/role_assignments?user.id=9e16d1e3f1cc4c71a32e10f7d9ddebec&scope.project.id=0cac2711920e47e2bf5e85de94f116b8&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:08.795465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7ca5-86da-40cf-98ee-4042af880bc4 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:08.796039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7ca5-86da-40cf-98ee-4042af880bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:08.796039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7ca5-86da-40cf-98ee-4042af880bc4 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:08.797449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 573/1147] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:08.803053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:08.803472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:08.803561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:08.822756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:08.823929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:08.880646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:08.899554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 575/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:08.931605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7ca5-86da-40cf-98ee-4042af880bc4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:09.050129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7ca5-86da-40cf-98ee-4042af880bc4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:09.088279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:09.089098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:09.089400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:09.089675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:09.091946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:09.102948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:02:09.110761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:09.111841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:02:09.113103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 574/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:09.118631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:09.221587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5dfd-2ff7-4ed1-b06d-dea4db370f5e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:09.263769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:09.264450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:09.264725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:09.264997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:09.265776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:09.266079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:09.267471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:09.277004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 576/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:09.283798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:09.397283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42b502-4776-4eda-87bd-41b3e0ee561f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:09.433454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:09.434307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:09.434594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:09.434846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] PATH_INFO: `/v3/users/9e16d1e3f1cc4c71a32e10f7d9ddebec` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:09.436130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] RBAC: Authorizing `identity:get_user(user_id=9e16d1e3f1cc4c71a32e10f7d9ddebec)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:09.437596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:09.439241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 575/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:02:09 2022] GET /identity/v3/users/9e16d1e3f1cc4c71a32e10f7d9ddebec => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:09.448440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:09.502247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:09.558568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ab83-07a4-47b5-8608-f1710c22cdb2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:09.594119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb635-ec89-4aeb-b4ba-68736b7c5e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:09.594977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb635-ec89-4aeb-b4ba-68736b7c5e78 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:09.595248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb635-ec89-4aeb-b4ba-68736b7c5e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:09.595516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb635-ec89-4aeb-b4ba-68736b7c5e78 None admin] PATH_INFO: `/v3/projects/0cac2711920e47e2bf5e85de94f116b8` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:09.596808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb635-ec89-4aeb-b4ba-68736b7c5e78 None admin] RBAC: Authorizing `identity:get_project(project_id=0cac2711920e47e2bf5e85de94f116b8)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:09.598331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb635-ec89-4aeb-b4ba-68736b7c5e78 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:09.600035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 577/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:02:09 2022] GET /identity/v3/projects/0cac2711920e47e2bf5e85de94f116b8 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:02:09.606736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:09.674355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:09.716874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8114-d8a9-46ec-b95a-5abfa0e89d16 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:09.752559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a7202-e9da-427a-a6b5-b1eb534f410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:09.753575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a7202-e9da-427a-a6b5-b1eb534f410f None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:09.753852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a7202-e9da-427a-a6b5-b1eb534f410f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:09.754117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a7202-e9da-427a-a6b5-b1eb534f410f None admin] PATH_INFO: `/v3/projects/0cac2711920e47e2bf5e85de94f116b8/users/9e16d1e3f1cc4c71a32e10f7d9ddebec/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:09.756326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a7202-e9da-427a-a6b5-b1eb534f410f None admin] RBAC: Authorizing `identity:create_grant(project_id=0cac2711920e47e2bf5e85de94f116b8, user_id=9e16d1e3f1cc4c71a32e10f7d9ddebec, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:09.757830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a7202-e9da-427a-a6b5-b1eb534f410f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:09.776351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 576/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:02:09 2022] PUT /identity/v3/projects/0cac2711920e47e2bf5e85de94f116b8/users/9e16d1e3f1cc4c71a32e10f7d9ddebec/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:02:11.747181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab6fd-ce67-408a-aaaf-908c89527900 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:11.747863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab6fd-ce67-408a-aaaf-908c89527900 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:11.747863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab6fd-ce67-408a-aaaf-908c89527900 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:11.749157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 578/1154] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:11.755503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:11.756258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:11.756400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:11.778305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:11.779998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:11.851915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 577/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:11.877937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceab6fd-ce67-408a-aaaf-908c89527900 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:11.992018 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceab6fd-ce67-408a-aaaf-908c89527900 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:12.010607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:12.031561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:12.032355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:12.032625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:12.032891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:12.042886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:02:12.050495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:12.051653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:02:12.052803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 579/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:02:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:12.058137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:12.113748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:12.163363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb747c-34ee-4f5f-b908-16ca8dfafbde None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:12.200908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:12.201597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:12.201871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:12.202143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:12.202882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:12.203186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:12.204563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:12.213557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 578/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:12.220198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:12.340157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b645a-45da-401c-87c3-6c5c2ed99918 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:12.375948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:12.376818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:12.377096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:12.377402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] PATH_INFO: `/v3/users/9e16d1e3f1cc4c71a32e10f7d9ddebec` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:12.378686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] RBAC: Authorizing `identity:get_user(user_id=9e16d1e3f1cc4c71a32e10f7d9ddebec)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:12.380116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:12.381793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 580/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:02:12 2022] GET /identity/v3/users/9e16d1e3f1cc4c71a32e10f7d9ddebec => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:12.390735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:12.515341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474b80-faf3-4e0d-a5fc-5715eab5df85 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:12.529188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:12.552247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:12.552887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:12.553161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:12.553465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:12.623437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:12.624916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:12.726848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 579/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:02:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:02:12.733914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:12.786632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:12.846190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c5ab-d31c-4a39-b310-ab5a0cc77118 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:12.881418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf34edb-7175-4b2a-81c6-f16d2a66e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:12.882265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf34edb-7175-4b2a-81c6-f16d2a66e376 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:12.882539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf34edb-7175-4b2a-81c6-f16d2a66e376 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:12.882807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf34edb-7175-4b2a-81c6-f16d2a66e376 None admin] PATH_INFO: `/v3/projects/0cac2711920e47e2bf5e85de94f116b8` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:12.884115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf34edb-7175-4b2a-81c6-f16d2a66e376 None admin] RBAC: Authorizing `identity:get_project(project_id=0cac2711920e47e2bf5e85de94f116b8)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:12.885572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf34edb-7175-4b2a-81c6-f16d2a66e376 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:12.887271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 581/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:02:12 2022] GET /identity/v3/projects/0cac2711920e47e2bf5e85de94f116b8 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:12.894077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:12.909541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:13.009397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e00a3-18f5-4499-9f08-b653e10cc128 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:13.047364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:13.048007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:13.048284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:13.048553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:13.049401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=0cac2711920e47e2bf5e85de94f116b8, user.id=9e16d1e3f1cc4c71a32e10f7d9ddebec) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:13.049716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:13.051130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecca964-60c4-473d-b7f6-884b14d17f62 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:13.057081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 580/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:02:12 2022] GET /identity/v3/role_assignments?user.id=9e16d1e3f1cc4c71a32e10f7d9ddebec&scope.project.id=0cac2711920e47e2bf5e85de94f116b8&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:15.094850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f127-981d-4721-9815-7ef0d3e7d69a None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:15.095782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f127-981d-4721-9815-7ef0d3e7d69a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:15.095782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f127-981d-4721-9815-7ef0d3e7d69a None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:15.098125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 582/1162] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:15.104873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:15.105639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:15.105776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:15.130490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:15.131710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:15.211102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 581/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:15.237438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580f127-981d-4721-9815-7ef0d3e7d69a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:15.354846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580f127-981d-4721-9815-7ef0d3e7d69a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:15.368232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:15.391336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:15.391997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:15.392275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:15.392544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:15.471220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:15.472660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:15.575279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 583/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:02:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:02:15.582204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:15.598193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:15.701385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008fa76-b09b-4dd5-8907-882be1082dfc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:15.736911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:15.737748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:15.738023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:15.738294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:15.745264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:15.746738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-568e85df-5a09-463f-aebd-0e17630622a9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:15.761068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:15.762275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:02:15.763160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 582/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:02:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:15.770742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:15.788283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:15.877032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911acfab-3b72-4f23-8a6d-af20d9623e3d None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:15.915438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:15.916095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:15.916378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:15.916641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:15.917458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:15.917775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:15.919287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154a72c-3ae2-4884-ad45-beed3b83c6da None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:15.927731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 584/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 20 09:02:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:17.947484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86724-7bd9-4d35-9849-5a68a349939f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:17.948092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86724-7bd9-4d35-9849-5a68a349939f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:17.948092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86724-7bd9-4d35-9849-5a68a349939f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:17.949409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 583/1167] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:17.955935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431681-7f74-4b14-9ac0-b63901c011b8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:17.956658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431681-7f74-4b14-9ac0-b63901c011b8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:17.956815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431681-7f74-4b14-9ac0-b63901c011b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:17.983400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-38431681-7f74-4b14-9ac0-b63901c011b8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:17.984689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-38431681-7f74-4b14-9ac0-b63901c011b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:18.054152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 585/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:18.077622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86724-7bd9-4d35-9849-5a68a349939f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:18.155530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:18.196220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86724-7bd9-4d35-9849-5a68a349939f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:18.231949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcd56-c0af-4db2-b1f8-deacb2fa3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:18.232545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcd56-c0af-4db2-b1f8-deacb2fa3437 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:18.232849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcd56-c0af-4db2-b1f8-deacb2fa3437 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:18.233115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcd56-c0af-4db2-b1f8-deacb2fa3437 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:18.233889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efcd56-c0af-4db2-b1f8-deacb2fa3437 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:18.235274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efcd56-c0af-4db2-b1f8-deacb2fa3437 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:18.254701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 584/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Wed Jul 20 09:02:18 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:02:20.353203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6111e-1343-4ae5-b8b4-521a2ac7768e None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:20.354108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6111e-1343-4ae5-b8b4-521a2ac7768e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:20.354108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6111e-1343-4ae5-b8b4-521a2ac7768e None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:20.356355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 586/1170] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:20.363134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:20.363871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:20.364145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:20.385121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:20.386373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:20.458381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 585/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:20.485568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6111e-1343-4ae5-b8b4-521a2ac7768e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:20.495859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:20.597495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6111e-1343-4ae5-b8b4-521a2ac7768e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:20.633953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aeeaa-387d-43a9-a32a-781d7854cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:20.634803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aeeaa-387d-43a9-a32a-781d7854cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:20.635075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aeeaa-387d-43a9-a32a-781d7854cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:20.635349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aeeaa-387d-43a9-a32a-781d7854cb4d None admin] PATH_INFO: `/v3/domains/b48c9cb4646745f5bb1caba0ad88a534` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:20.646264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aeeaa-387d-43a9-a32a-781d7854cb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=b48c9cb4646745f5bb1caba0ad88a534)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:20.647728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aeeaa-387d-43a9-a32a-781d7854cb4d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:20.649450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 587/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Jul 20 09:02:20 2022] GET /identity/v3/domains/b48c9cb4646745f5bb1caba0ad88a534 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:20.656554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:20.726672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:20.775691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a51adc-1657-4fcd-bf0d-0b075c84e5ce None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:20.813609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3a57d-a1c3-4543-844a-3bef96e2bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:20.814260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a57d-a1c3-4543-844a-3bef96e2bfbf None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:20.814539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a57d-a1c3-4543-844a-3bef96e2bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:20.814807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a57d-a1c3-4543-844a-3bef96e2bfbf None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:20.815547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3a57d-a1c3-4543-844a-3bef96e2bfbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:20.816976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3a57d-a1c3-4543-844a-3bef96e2bfbf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:20.848705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 586/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:02:20 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:02:22.937830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b084209-f3b1-44df-bc14-4a1d1eac8d55 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:22.938419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b084209-f3b1-44df-bc14-4a1d1eac8d55 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:22.938419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b084209-f3b1-44df-bc14-4a1d1eac8d55 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:22.939766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 588/1174] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:22.946222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:22.946940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:22.947099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:22.967470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:22.968657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:23.050091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 587/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:23.075209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b084209-f3b1-44df-bc14-4a1d1eac8d55 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:23.163841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:23.214663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b084209-f3b1-44df-bc14-4a1d1eac8d55 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:23.256642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f8e88-9157-4cc4-bbe1-cb44e7a13912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:23.257539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f8e88-9157-4cc4-bbe1-cb44e7a13912 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:23.257814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f8e88-9157-4cc4-bbe1-cb44e7a13912 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:23.258089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f8e88-9157-4cc4-bbe1-cb44e7a13912 None admin] PATH_INFO: `/v3/domains/b48c9cb4646745f5bb1caba0ad88a534` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:23.259327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f8e88-9157-4cc4-bbe1-cb44e7a13912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b48c9cb4646745f5bb1caba0ad88a534)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:23.260773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f8e88-9157-4cc4-bbe1-cb44e7a13912 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:23.262440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 589/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Jul 20 09:02:23 2022] GET /identity/v3/domains/b48c9cb4646745f5bb1caba0ad88a534 => generated 267 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:23.268504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:23.312987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:23.376152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca509c-5674-48a1-be95-550c9ce461b7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:23.413272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aa372-c30a-4d1d-b6f7-5794e808b8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:23.413957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aa372-c30a-4d1d-b6f7-5794e808b8f6 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:23.414229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aa372-c30a-4d1d-b6f7-5794e808b8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:23.414492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aa372-c30a-4d1d-b6f7-5794e808b8f6 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:23.415186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6aa372-c30a-4d1d-b6f7-5794e808b8f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:23.416614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6aa372-c30a-4d1d-b6f7-5794e808b8f6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:23.444079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 588/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:02:23 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:02:25.517908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faddaf-55b7-4833-9216-e7ea55ef49a2 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:25.518493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faddaf-55b7-4833-9216-e7ea55ef49a2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:25.518493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faddaf-55b7-4833-9216-e7ea55ef49a2 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:25.519918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 590/1178] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:25.525461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:25.525880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:25.525987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:25.544725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:25.545924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:25.628868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 589/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:25.663001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faddaf-55b7-4833-9216-e7ea55ef49a2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:25.779196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faddaf-55b7-4833-9216-e7ea55ef49a2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:25.817245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:25.818049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:25.818330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:25.818591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:25.820814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:25.830487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:02:25.838165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:25.839367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:02:25.840688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 591/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:25.845823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:25.877836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:25.958416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f85a12-8b11-4695-8434-ba8b2b40f5ae None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:25.996870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:25.997616 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:25.997910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:25.998173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:25.998933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:25.999229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:26.000610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:26.010469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 590/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:26.017541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:26.136132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd40c-8318-4e7e-ad0b-e06fc73f8892 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:26.170587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:26.171458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:26.171728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:26.171990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] PATH_INFO: `/v3/users/6fa2a85adcef40eb97a7e77bf288ed86` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:26.186215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa2a85adcef40eb97a7e77bf288ed86)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:26.187653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:26.189334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 592/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:02:26 2022] GET /identity/v3/users/6fa2a85adcef40eb97a7e77bf288ed86 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:26.196057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:26.305554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:26.321027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6cf98-8289-4ee7-9a97-1280f90d0269 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:26.358359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:26.359000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:26.359277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:26.359544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:26.433956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:26.435498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:26.530456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:26.543189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 591/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:02:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:02:26.550083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:26.612452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:26.668390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1a491-4359-42de-acd4-25901bddf565 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:26.704596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8572-01c9-445e-b6cc-e3c30945760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:26.705489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8572-01c9-445e-b6cc-e3c30945760d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:26.705764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8572-01c9-445e-b6cc-e3c30945760d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:26.706036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8572-01c9-445e-b6cc-e3c30945760d None admin] PATH_INFO: `/v3/projects/4291b72dc4a44894b52d20609dc8236d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:26.707343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8572-01c9-445e-b6cc-e3c30945760d None admin] RBAC: Authorizing `identity:get_project(project_id=4291b72dc4a44894b52d20609dc8236d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:26.708789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8572-01c9-445e-b6cc-e3c30945760d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:26.710535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 593/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:02:26 2022] GET /identity/v3/projects/4291b72dc4a44894b52d20609dc8236d => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:26.719882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:26.826547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77530f27-3838-41c4-b439-2ae002adca17 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:26.862694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:26.863334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:26.863612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:26.863879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:26.864707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=4291b72dc4a44894b52d20609dc8236d, user.id=6fa2a85adcef40eb97a7e77bf288ed86) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:26.865017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:26.866484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcbfd-d8c1-48b2-a1bd-f5a900452c24 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:26.871959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 592/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:02:26 2022] GET /identity/v3/role_assignments?user.id=6fa2a85adcef40eb97a7e77bf288ed86&scope.project.id=4291b72dc4a44894b52d20609dc8236d&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:02:28.887471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a4cab-3e23-47af-8fed-58c8fae34ecc None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:28.888601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a4cab-3e23-47af-8fed-58c8fae34ecc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:28.888601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a4cab-3e23-47af-8fed-58c8fae34ecc None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:28.890622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 594/1186] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:28.896238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:28.896687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:28.896787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:28.915241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:28.916416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:28.964184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:28.985826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 593/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:02:29.009040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a4cab-3e23-47af-8fed-58c8fae34ecc None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:29.123980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a4cab-3e23-47af-8fed-58c8fae34ecc None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:29.149807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:29.166165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:29.166957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:29.167232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:29.167506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:29.178029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:02:29.185760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:29.186827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:02:29.187669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 595/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:29.196160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:29.306682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10766-ffef-4d86-9d3d-4b43a8caa71e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:29.344474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:29.345142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:29.345456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:29.345735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:29.346479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:29.346787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:29.348176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:29.356702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 594/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:29.363498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:29.470918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42be4b-1038-4d4a-bbc6-c45a71912d5f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:29.506119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:29.506983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:29.507254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:29.507525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] PATH_INFO: `/v3/users/6fa2a85adcef40eb97a7e77bf288ed86` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:29.508844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa2a85adcef40eb97a7e77bf288ed86)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:29.510305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:29.511935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 596/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:02:29 2022] GET /identity/v3/users/6fa2a85adcef40eb97a7e77bf288ed86 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:29.522195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:29.578993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:29.636714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa39900-5332-4688-9b01-c4f0c3f5a0b5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:29.676833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc769d-e6cf-4987-b721-cb5fe6386b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:29.678205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc769d-e6cf-4987-b721-cb5fe6386b5d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:29.678595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc769d-e6cf-4987-b721-cb5fe6386b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:29.678817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc769d-e6cf-4987-b721-cb5fe6386b5d None admin] PATH_INFO: `/v3/projects/4291b72dc4a44894b52d20609dc8236d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:29.680904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc769d-e6cf-4987-b721-cb5fe6386b5d None admin] RBAC: Authorizing `identity:get_project(project_id=4291b72dc4a44894b52d20609dc8236d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:29.683237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc769d-e6cf-4987-b721-cb5fe6386b5d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:29.685911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 595/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:02:29 2022] GET /identity/v3/projects/4291b72dc4a44894b52d20609dc8236d => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:29.695951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:29.758569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:29.817631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbb434-62f2-4d7d-8405-49ef88cddd73 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:29.856367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827af91-4e20-4633-883a-9268b99bc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:29.857693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827af91-4e20-4633-883a-9268b99bc2b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:29.857972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827af91-4e20-4633-883a-9268b99bc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:29.858243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827af91-4e20-4633-883a-9268b99bc2b7 None admin] PATH_INFO: `/v3/projects/4291b72dc4a44894b52d20609dc8236d/users/6fa2a85adcef40eb97a7e77bf288ed86/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:29.860243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827af91-4e20-4633-883a-9268b99bc2b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4291b72dc4a44894b52d20609dc8236d, user_id=6fa2a85adcef40eb97a7e77bf288ed86, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:29.861717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827af91-4e20-4633-883a-9268b99bc2b7 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:29.877773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 597/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:02:29 2022] PUT /identity/v3/projects/4291b72dc4a44894b52d20609dc8236d/users/6fa2a85adcef40eb97a7e77bf288ed86/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:02:31.897993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f8321-377d-4f3e-bdab-1dd643a3f34e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:31.898588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f8321-377d-4f3e-bdab-1dd643a3f34e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:31.898588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f8321-377d-4f3e-bdab-1dd643a3f34e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:31.900705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 596/1193] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:02:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:02:31.909067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:31.909568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:31.909765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:31.928526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:02:31.929776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:02:32.000108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 598/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:02:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:02:32.025280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f8321-377d-4f3e-bdab-1dd643a3f34e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:32.161600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f8321-377d-4f3e-bdab-1dd643a3f34e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:32.176883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:32.208625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:32.209469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:32.209753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:32.210031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:32.221009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:02:32.229067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:02:32.230246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:02:32.231476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 597/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:02:32.239001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:32.283772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:32.351236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e38003-c286-44e3-a0cd-4d77f6eeb66c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:32.388629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:32.389297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:32.389603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:32.389874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:32.390624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:32.390928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:32.392415 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:32.400643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 599/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:32.407091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:32.530121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42767d42-f21a-49db-ae36-8ea27c4aca66 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:32.577550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:32.578422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:32.578702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:32.578975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] PATH_INFO: `/v3/users/6fa2a85adcef40eb97a7e77bf288ed86` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:32.580292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] RBAC: Authorizing `identity:get_user(user_id=6fa2a85adcef40eb97a7e77bf288ed86)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:32.581775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:32.583419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 598/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 20 09:02:32 2022] GET /identity/v3/users/6fa2a85adcef40eb97a7e77bf288ed86 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:32.593582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:32.704287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:32.707542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b297e2-d9ca-4a68-9a2e-d15ff3504a5e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:32.743990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:32.744627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:32.744904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:32.745177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:32.814810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:32.816273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:32.916536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:32.920953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 600/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:02:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:02:32.927204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:32.973645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:33.037176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c02d-7ef0-4443-858e-bb9a50ec007c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:33.071973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deb359-899d-44f6-81cd-b14f0753b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:33.072767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb359-899d-44f6-81cd-b14f0753b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:33.073048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb359-899d-44f6-81cd-b14f0753b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:33.073342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb359-899d-44f6-81cd-b14f0753b1a9 None admin] PATH_INFO: `/v3/projects/4291b72dc4a44894b52d20609dc8236d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:33.074660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb359-899d-44f6-81cd-b14f0753b1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4291b72dc4a44894b52d20609dc8236d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:33.076477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb359-899d-44f6-81cd-b14f0753b1a9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:33.078243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 599/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 20 09:02:32 2022] GET /identity/v3/projects/4291b72dc4a44894b52d20609dc8236d => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:33.085223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:02:33.196420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c09b-5de9-49a6-a465-4d25ca44aa12 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:02:33.232419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:02:33.233062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:02:33.233368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:02:33.233645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:02:33.234468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=4291b72dc4a44894b52d20609dc8236d, user.id=6fa2a85adcef40eb97a7e77bf288ed86) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:02:33.234770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:02:33.236191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319863-d76d-4467-a53d-5b964b3d27a5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:02:33.242157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 601/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:02:33 2022] GET /identity/v3/role_assignments?user.id=6fa2a85adcef40eb97a7e77bf288ed86&scope.project.id=4291b72dc4a44894b52d20609dc8236d&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:02:43.066680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=46 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:02:43.239417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=68 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:29.168112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da22e6-8ab3-4822-bb7b-bd9a1eb9818c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:29.168112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da22e6-8ab3-4822-bb7b-bd9a1eb9818c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:29.168112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da22e6-8ab3-4822-bb7b-bd9a1eb9818c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:29.169216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 600/1201] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:29.175196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:29.176129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:29.176591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:29.194641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:29.196106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:29.293339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 602/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:29.318009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da22e6-8ab3-4822-bb7b-bd9a1eb9818c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:29.440038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da22e6-8ab3-4822-bb7b-bd9a1eb9818c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:29.496036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:29.497915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:29.498471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:29.498918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:29.515368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:29.517567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:29.549043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:29.550913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:29.552196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:29.552196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:29.552196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:29.552196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:29.552196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 601/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:29.559306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:29.701485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0428cd-ffa2-4db4-888f-120635ddb1fd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:29.742992 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:29.749623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:29.750354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:29.750636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:29.750927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:29.751925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:29.752273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:29.754054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71b038-e46c-4b75-87b5-ed74dee1de9a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:29.771622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 603/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:29.777427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:29.851595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:29.913857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde930bd-3a58-4e4f-a8db-1e15dc24725e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:29.954409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b20e-4b27-4e4c-9f3d-bded4060582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:29.956793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b20e-4b27-4e4c-9f3d-bded4060582c None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:29.956793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b20e-4b27-4e4c-9f3d-bded4060582c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:29.956793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b20e-4b27-4e4c-9f3d-bded4060582c None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:29.956793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99b20e-4b27-4e4c-9f3d-bded4060582c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:29.957909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99b20e-4b27-4e4c-9f3d-bded4060582c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:29.980468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 602/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 20 09:03:29 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:03:32.248791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5c862-e0ec-4b99-a167-d0bba1c88c73 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:32.249392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5c862-e0ec-4b99-a167-d0bba1c88c73 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:32.249392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5c862-e0ec-4b99-a167-d0bba1c88c73 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:32.250939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 604/1206] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:32.256908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:32.257618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:32.257618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:32.277959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:32.279357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:32.360861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 603/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:32.384706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5c862-e0ec-4b99-a167-d0bba1c88c73 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:32.508382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5c862-e0ec-4b99-a167-d0bba1c88c73 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:32.546766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:32.547575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:32.547926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:32.548220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:32.559941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:03:32.567988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:32.569053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:03:32.569922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:32.574442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 605/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:32.575442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:32.629027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:32.727010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5afae8-6720-41b0-9b78-5a5d76b52e9b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:32.771809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:32.772500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:32.772781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:32.773059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:32.773934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:32.774319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:32.775746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:32.786757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 604/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:32.794787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:32.856903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:32.919721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109ffe1-4629-453d-9b91-943374971324 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:32.959904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:32.960763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:32.961030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:32.961322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:32.975473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:32.977255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:32.998714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:32.999711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:33.000598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:33.000598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:33.000598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:33.000598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:33.000598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 606/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:33.006631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:33.119833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:33.127433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb24b-4633-492b-82cb-7e235dcfd1ac None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:33.176284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:33.177164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:33.177477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:33.177782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:33.178700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:33.179039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:33.180497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:33.195486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 605/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:33.201853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:33.326320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf4a6-83d0-4f37-951e-3f4150456aa2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:33.328079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:33.366211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:33.367689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:33.367945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:33.368703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:33.379315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:33.381216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:03:33.398413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:33.400576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:33.401700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:33.407389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:33.408530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 607/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:03:33.535345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897175cc-c209-439d-979d-c0d4a4a6fdbd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:33.581689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:33.582718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:33.583069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:33.583455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:33.584252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:33.584560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:33.586266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:33.615365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 606/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 20 09:03:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:33.616835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:33.740353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073640da-ff7a-4284-a805-76a24cf46b65 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:33.786587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:33.787317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:33.787535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:33.787894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:33.825430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:33.876141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:33.877825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:33.999471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 608/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:03:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:03:34.006381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:34.030993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:34.126113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559eba-326d-4f6d-82ca-7fcd3c785c6c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:34.164460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:34.165495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:34.165900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:34.166238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:34.178329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:34.179864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:34.198499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:34.199900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:34.201060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:34.201060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:34.201060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:34.201060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:34.201060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 607/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:34.207325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:34.276334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:34.318248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6f7c1-33a7-4cdc-a887-a78ddb5aba24 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:34.361497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:34.362158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:34.362429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:34.362710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:34.363448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:34.363747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:34.365137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:34.379413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 609/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:34.385505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:34.466473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:34.503546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1e1d-ee96-4905-b907-a048e0d13322 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:34.543276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:34.544053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:34.544346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:34.544638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:34.552446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:34.553949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:03:34.568945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:34.571090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:34.572086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:34.575412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 608/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:34.576467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:34.692209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046bbb-2b0b-49b9-bfa3-6f42fc5450b9 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:34.719015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:34.735089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:34.735959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:34.736374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:34.736789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:34.737765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:34.738110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:34.739611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692247-dde8-4027-bdfd-1a94f6e0a648 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:34.754049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 610/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:34.760296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:34.872878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411a6a-3480-46aa-9a0c-858cde8f0326 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:34.903596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:34.910679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:34.911430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:34.911708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:34.912031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:34.912863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=d3b3524ba3d94d45ad789b39e0380b27) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:34.913217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:34.914833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d36c-f671-4952-88d1-2faecd747af7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:34.933727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 609/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:03:34 2022] GET /identity/v3/role_assignments?user.id=d3b3524ba3d94d45ad789b39e0380b27&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:37.088182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bed6d5-dff2-41cb-8025-cf7d8a0ac6af None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:37.088772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bed6d5-dff2-41cb-8025-cf7d8a0ac6af None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:37.088772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bed6d5-dff2-41cb-8025-cf7d8a0ac6af None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:37.090228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 611/1220] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:37.096295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:37.096791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:37.096884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:37.116110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:37.117437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:37.196005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 610/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:37.223151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bed6d5-dff2-41cb-8025-cf7d8a0ac6af None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:37.346897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bed6d5-dff2-41cb-8025-cf7d8a0ac6af None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:37.385512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:37.386414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:37.386690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:37.386964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:37.398219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:03:37.407400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:37.408560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:37.409569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 612/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:37.416324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:37.533274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa80910-fa4a-40c2-acb2-9ebcde525560 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:37.558740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:37.571573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:37.572279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:37.572556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:37.572826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:37.573642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:37.574105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:37.575537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:37.584368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 611/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:37.590530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:37.640206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:37.700716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bcb14-f595-4233-82ed-7114b48fafff None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:37.738731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:37.739561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:37.739836 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:37.740100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:37.751098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:37.752538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:37.770453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:37.771623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:37.772560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:37.772560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:37.772560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:37.772560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:37.772560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 613/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:37.779331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:37.898564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b74f8-26f9-462f-9a1d-93543561d768 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:37.938324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:37.939086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:37.939545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:37.939826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:37.940566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:37.940974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:37.942578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:37.957380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 612/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:37.963972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:38.069897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:38.077358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e523-634c-498f-90de-01488ba54a5b None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:38.115847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:38.116838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:38.117106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:38.117330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:38.125789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:38.127378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:03:38.142931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:38.144198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:38.145670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 614/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:38.150445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:38.202614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:38.263001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a2fb-562f-42db-914d-6b7997fbb461 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:38.299192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:38.299957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:38.300222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:38.300488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:38.301449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:38.301761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:38.304903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:38.323953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 613/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 20 09:03:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:38.330213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:38.440573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb858-fc51-418f-8fb4-4e16c2062ba2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:38.478087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:38.478917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:38.479202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:38.479474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:38.490527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:38.492026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:38.511159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:38.512273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:38.513453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:38.513453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:38.513453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:38.513453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:38.513453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 615/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:38.519125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:38.630826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162786-5843-4685-9ebe-b2b9712533a3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:38.633345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:38.667731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:38.668620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:38.668899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:38.669171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:38.669936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:38.670243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:38.671684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:38.689338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 614/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:38.690918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:38.701020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:38.812441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236756-7afb-4b15-bce1-98519ae16a23 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:38.850406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:38.851354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:38.851670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:38.851959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:38.861608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:38.863103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:03:38.879182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:38.881048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:38.883193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 616/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:38.888692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:39.005353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e11eb-ccaf-45b1-85e0-bd912a73c292 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:39.052774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:39.053585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:39.053878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:39.054190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:39.055061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:39.055394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:39.057119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c4ee9-4cd4-4f9d-9afb-c4143c7175be None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:39.072868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 615/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:39.080227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:39.162455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:39.202098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427ee9-eeb4-4ab3-a473-5020cda28923 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:39.240310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a175f-df5b-4ca3-8b8b-2bc90de76d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:39.241214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a175f-df5b-4ca3-8b8b-2bc90de76d98 None admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:39.241593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a175f-df5b-4ca3-8b8b-2bc90de76d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:39.241865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a175f-df5b-4ca3-8b8b-2bc90de76d98 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/d3b3524ba3d94d45ad789b39e0380b27/roles/500c93384d994628af0bd2e13816f736` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:39.258533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a175f-df5b-4ca3-8b8b-2bc90de76d98 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=d3b3524ba3d94d45ad789b39e0380b27, role_id=500c93384d994628af0bd2e13816f736)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:39.260176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a175f-df5b-4ca3-8b8b-2bc90de76d98 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:39.275151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 617/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:03:39 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/d3b3524ba3d94d45ad789b39e0380b27/roles/500c93384d994628af0bd2e13816f736 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:03:41.359513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af424b49-8265-4236-a974-8a9673963e77 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:41.360068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af424b49-8265-4236-a974-8a9673963e77 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:41.360068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af424b49-8265-4236-a974-8a9673963e77 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:41.361496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 616/1233] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:41.366926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:41.367405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:41.367612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:41.389291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:41.390703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:41.465014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 618/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:41.490264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af424b49-8265-4236-a974-8a9673963e77 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:41.518804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:41.608915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af424b49-8265-4236-a974-8a9673963e77 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:41.648852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:41.649701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:41.649981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:41.650253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:41.662009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:03:41.670337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:41.671506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:41.672721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 617/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 20 09:03:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:41.678291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:41.728029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:41.787380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddbdfb-ad02-4636-b0d5-0b4ffbe5adb5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:41.823677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:41.824636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:41.824950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:41.825193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:41.825979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] RBAC: Adding query filter params (name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:41.826280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:41.827668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:41.836186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 619/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 20 09:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:41.842225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:41.937171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:41.956692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35931b-0c30-4855-81e1-527069d73050 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:41.991570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:41.992369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:41.992650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:41.992923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:42.004318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:42.005857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:42.023791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:42.025070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:42.026032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:42.026032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:42.026032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:42.026032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:42.026032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 618/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:42.031573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:42.149620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1e2c-0581-4688-ada8-318a436e139c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:42.160372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:42.190175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:42.190848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:42.191173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:42.191451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:42.192181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:42.192496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:42.193933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:42.208867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 620/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:42.215281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:42.340211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5b58-cb0f-48fe-80cd-e84b27596c0b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:42.376641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:42.377691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:42.378053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:42.378399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:42.382308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:42.388663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:42.390492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:03:42.406168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:42.407373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:42.408538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 619/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:42.415632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:42.529498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020f87-52fe-4a01-a561-7494595e54ed None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:42.569976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:42.570660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:42.570936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:42.571212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:42.572084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:42.572391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:42.574163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:42.593249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 621/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 20 09:03:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:42.599277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:42.731939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba8bb7-6817-49b3-8deb-d830c3f89580 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:42.771140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:42.771901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:42.772186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:42.772505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:42.844997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:42.853698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:42.855349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:42.963157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 620/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:03:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:03:42.969288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:42.999519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:43.081552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5644c-374e-4c1d-9511-86b34dc24a5e None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:43.122506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:43.123400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:43.123691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:43.124022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:43.135017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:43.136981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:43.159440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:43.160680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:43.166455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:43.166455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:43.166455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:43.166455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:43.166455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 622/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:43.166805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:43.277954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:43.284579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41579c-8c73-40ca-a85d-77cd796dfcb4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:43.321826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:43.322495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:43.322778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:43.323035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:43.323957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:43.324502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:43.325951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:43.338606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 621/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:43.344804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:43.427447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:43.452922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb0e2f-1af3-48f3-9f5c-9361795d9e19 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:43.494428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:43.495460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:43.495829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:43.496105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:43.504186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:43.505810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:03:43.520956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:43.522242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:43.528864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 623/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:43.529999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:43.652426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858045-0e05-44eb-91c2-51393187ba4d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:43.692815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:43.693579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:43.693907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:43.694179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:43.695181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:43.695549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:43.697214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059016e-9ec4-49ed-970e-c660557ed4c6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:43.711004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 622/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:43.718925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:43.833210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c8b80-8466-4abd-b991-2b3c48427fe5 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:43.875552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:43.876485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:43.876998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:43.877307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:43.878149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] RBAC: Adding query filter params (role.id=500c93384d994628af0bd2e13816f736, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=d3b3524ba3d94d45ad789b39e0380b27) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:43.878459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:43.879906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16750e24-aebd-426b-b97f-eb9d0c3f8528 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:43.888693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 624/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:03:43 2022] GET /identity/v3/role_assignments?user.id=d3b3524ba3d94d45ad789b39e0380b27&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=500c93384d994628af0bd2e13816f736 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:46.257771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e02a3-d8fe-42ac-aee4-11847c51f2ee None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:46.258403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e02a3-d8fe-42ac-aee4-11847c51f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:46.258594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e02a3-d8fe-42ac-aee4-11847c51f2ee None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:46.260209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 623/1247] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:46.266182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:46.266661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:46.266789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:46.272305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:46.285330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:46.286546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:46.367285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 625/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:46.391629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e02a3-d8fe-42ac-aee4-11847c51f2ee None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:46.412707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:46.511215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e02a3-d8fe-42ac-aee4-11847c51f2ee None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:46.545940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:46.546828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:46.547052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:46.547326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:46.560872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:03:46.569091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:46.570334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:46.571440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 624/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:46.576917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:46.688438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd6a2-6dd7-4f05-b860-67c9ca3cd47a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:46.720047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:46.726077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:46.726819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:46.727100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:46.727379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:46.728218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:46.728531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:46.730153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:46.738917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 626/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:46.744670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:46.836668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:46.866642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faee02-a8bf-4b2f-a243-d90cc66c7e92 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:46.906718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:46.907622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:46.907941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:46.908251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:46.923075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:46.924712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:46.944394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:46.945532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:46.946881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:46.946881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:46.946881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:46.946881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:46.946881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 625/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:46.952047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:47.075822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9cb5-eb16-41a2-afdd-6ba82589d8bc None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:47.120684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:47.120994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:47.121485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:47.121892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:47.122638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:47.122967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:47.124604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:47.138314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 627/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:47.146445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:47.264337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d3e7-0fda-45b5-be23-12fda1fadffe None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:47.293391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:47.301862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:47.302950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:47.303251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:47.303537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:47.313177 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:47.314701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:03:47.331309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:47.332615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:47.334115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 626/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:47.339711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:47.407072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:47.458911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11fdd-c600-4e65-8733-25dcb2662ba6 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:47.499349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:47.500107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:47.500465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:47.500751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:47.501764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:47.502102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:47.503776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:47.523705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 628/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 20 09:03:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:47.530304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:47.654353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849095f-8e7a-4b18-9d31-8c17bd770e56 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:47.693277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:47.693955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:47.694272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:47.694578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:47.764395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:47.779712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:47.781953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:47.905971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 627/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:03:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:03:47.912262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:48.024776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3508a-3e8a-4c5e-8115-942725f1e8c1 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:48.041464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:48.067605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:48.069208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:48.069718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:48.070078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:48.082454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:48.083978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:48.104390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:48.105643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:48.106847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:48.106847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:48.106847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:48.106847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:48.106847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 629/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:03:48.112735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:48.210251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:48.228799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cb28-7a03-46aa-b2e2-350a9afc815d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:48.267879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:48.268668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:48.268832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:48.269090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:48.269899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:48.270169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:48.271590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:48.284182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 628/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:48.290993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:48.414946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5ffb6-257a-475d-b7b6-87f3678de0f2 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:48.451247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:48.452038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:48.452318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:48.452617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:48.459716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:48.461202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:03:48.476882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:48.478187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:48.479077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 630/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:48.484682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:48.592511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06dfc2-fde7-482c-8651-5c4c1c2eb76c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:48.630810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:48.631565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:48.631842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:48.632078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:48.632869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:48.633170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:48.634718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eabf7-2641-4ba9-ae94-a04cc47548f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:48.647845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 629/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:48.655290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:48.684381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:48.763750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4eb2-69a6-4984-8950-f5091404edae None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:48.802236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:48.802896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:48.803161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:48.803431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:48.804420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=d3b3524ba3d94d45ad789b39e0380b27) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:48.804698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:48.806367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799611-600b-4262-b8d4-5f434d38fe2a None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:48.812883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 631/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:03:48 2022] GET /identity/v3/role_assignments?user.id=d3b3524ba3d94d45ad789b39e0380b27&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:50.884525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228480a-a8fe-45a5-8388-825c4799c8d9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:50.885086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228480a-a8fe-45a5-8388-825c4799c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:50.885086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228480a-a8fe-45a5-8388-825c4799c8d9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:50.886609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 630/1261] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:50.892956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:50.893749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:50.893886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:50.922347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:50.923544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:50.994672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 632/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:51.028794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228480a-a8fe-45a5-8388-825c4799c8d9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:51.041167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:51.146190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228480a-a8fe-45a5-8388-825c4799c8d9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:51.182243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:51.183336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:51.183684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:51.183966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:51.194672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:03:51.202356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:51.203531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:51.209698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 631/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:51.210568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:51.231510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:51.320006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce9382-d989-43ca-8179-016dd67f021a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:51.367330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:51.368388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:51.368845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:51.369315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:51.370692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:51.371196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:51.373490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:51.387393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 633/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:51.396998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:51.480572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:51.527178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb87c0-6164-4a60-ab05-8d54ca031e78 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:51.564897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:51.565804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:51.566110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:51.566424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:51.578596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:51.580089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:51.599564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:51.600609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:51.601856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:51.601856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:51.601856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:51.601856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:51.601856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 632/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:51.607019 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:51.691968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:51.714190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5583d7-15d1-4f88-9649-501fb26a23af None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:51.756686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:51.757407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:51.757681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:51.757947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:51.758700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:51.759009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:51.760427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:51.773050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 634/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:51.779391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:51.884325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53796f33-d524-4c1f-b1eb-5aeef0b9c6cf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:51.904985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:51.920585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:51.921523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:51.921798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:51.922066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:51.929695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:51.931126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:03:51.946778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:51.947864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:51.949628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 633/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:51.957784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:52.078353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22edb12-0dc1-4e64-88ed-b65b19408598 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:52.120694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:52.121377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:52.121650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:52.121913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:52.122750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:52.123057 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:52.124481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:52.133400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:52.142247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 635/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 20 09:03:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:52.148649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:52.263581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a061a-d935-4389-a35b-6d6a8861a532 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:52.298773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:52.299577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:52.299859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:52.300132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:52.311962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:52.313480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:52.330996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:52.332037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:52.332946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:52.332946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:52.332946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:52.332946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:52.332946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 634/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:52.338304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:52.444821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ea295-46a7-4d98-9634-75584ab9852c None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:52.486393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:52.487085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:52.487364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:52.487635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:52.488382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:52.488697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:52.490089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:52.502543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 636/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:52.508663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:52.546125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:52.619815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1b14-a7e6-408b-83d5-fecce3922cd8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:52.656757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:52.657613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:52.657890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:52.658160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:52.665770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:52.667378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:03:52.687799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:52.688835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:52.691179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 635/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:52.695253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:52.756990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:52.811283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89d3d-d967-4c0b-9170-87dc1c5b84b0 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:52.848658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:52.849696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:52.849976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:52.850245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:52.851069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:52.851366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:52.852826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24b396-19e1-4553-afa4-ec190caeea20 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:52.865598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 637/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:52.875983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:52.983595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:52.994672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab81db-bb18-4a7a-ba2c-8fe6539b8fb7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:53.035146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b19b9-c27d-42c1-90d7-84671e626f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:53.036632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b19b9-c27d-42c1-90d7-84671e626f76 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:53.037000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b19b9-c27d-42c1-90d7-84671e626f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:53.037566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b19b9-c27d-42c1-90d7-84671e626f76 None admin] PATH_INFO: `/v3/projects/974a10cf529746abaaf5b8430cc01156/users/d3b3524ba3d94d45ad789b39e0380b27/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:53.041189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b19b9-c27d-42c1-90d7-84671e626f76 None admin] RBAC: Authorizing `identity:create_grant(project_id=974a10cf529746abaaf5b8430cc01156, user_id=d3b3524ba3d94d45ad789b39e0380b27, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:53.043417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b19b9-c27d-42c1-90d7-84671e626f76 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:53.060592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 636/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 20 09:03:52 2022] PUT /identity/v3/projects/974a10cf529746abaaf5b8430cc01156/users/d3b3524ba3d94d45ad789b39e0380b27/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:03:55.101251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a875ca-4d04-4f8f-bde0-0fbcc1e98263 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:55.101852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a875ca-4d04-4f8f-bde0-0fbcc1e98263 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:55.101852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a875ca-4d04-4f8f-bde0-0fbcc1e98263 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:55.103216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 638/1274] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:55.110003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:55.110712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:55.110894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:55.138281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:55.139520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:55.220805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 637/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:03:55.245264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a875ca-4d04-4f8f-bde0-0fbcc1e98263 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:55.375002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a875ca-4d04-4f8f-bde0-0fbcc1e98263 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:55.391983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:55.409498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:55.410284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:55.410557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:55.410821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:55.420775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:03:55.428568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:55.429658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:55.430629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 639/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 20 09:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:55.436822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:55.533056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:55.562329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fdf43-dd5d-428b-b852-60bb792ac085 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:55.596555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:55.597217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:55.597525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:55.597789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:55.598526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:55.598824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:55.600581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:55.609122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 638/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 20 09:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:55.615790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:55.729977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc238de-cccd-4d65-851e-1847f0039317 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:55.765167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:55.766010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:55.766290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:55.766564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:55.778210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:55.779685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:55.797523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:55.798550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:55.800555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:55.800555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:55.800555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:55.800555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:55.800555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 640/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:55.808495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:55.918753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205af2e-468b-438f-a538-f9189d12cf04 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:55.954452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:55.955123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:55.955377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:55.955653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:55.956415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:55.956726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:55.958372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:55.970473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 639/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:55.977509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:56.012584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:56.104111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48ea28-f907-48cd-99c1-37f806899276 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:56.142372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:56.143204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:56.143481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:56.143751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:56.153140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:56.154730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:03:56.176467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:56.177629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:03:56.178668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 641/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:56.183767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:56.187748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:56.293650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec67e3-4191-41ea-9bce-5e6aa4693529 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:56.333249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:56.333925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:56.334205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:56.334468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:56.335318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:56.335648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:56.337122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:56.355289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 640/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 20 09:03:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:56.361402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:56.454429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:56.465388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60301b24-d22c-4aa9-a0cc-266f5c2eacf8 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:56.499303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:56.500069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:56.500344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:56.500624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:56.587557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:56.589810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:56.697445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:56.713786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 642/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 20 09:03:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:03:56.719980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:56.785959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:56.829918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f907-dec7-43ce-bde3-74730854b28d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:56.866507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:56.867233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:56.867473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:56.867777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:56.880142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:56.881640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:03:56.900866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:56.901931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:56.903034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:03:56.903034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:03:56.903034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:03:56.903034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:56.903034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 641/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:56.908758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:57.015016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9fa0-9c69-4ba9-945d-1b7bb2d1e32f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:57.053443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:57.054129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:57.054400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:57.054668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:57.055403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:57.055703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:57.057130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:57.068916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 643/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 20 09:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:03:57.075134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:57.189073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac86b9-e887-480d-84a9-077f56b1bdbc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:57.203954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:57.228597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:57.229448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:57.229723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:57.229992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:57.237376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:57.238834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:03:57.258904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:03:57.259917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jul 20 09:03:57.261107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 642/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 20 09:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:03:57.267582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:57.329398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:03:57.386605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70a9a-fd0f-49c7-92e4-03ebe7420fcf None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:57.421126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:57.421819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:57.422097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:57.422361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:57.423142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:57.423449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:57.424887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a31f0-398e-414c-8d99-3c2c7fd73ea4 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:57.436965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 644/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 20 09:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:57.443754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:03:57.543926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400a2d5-35f8-4496-b85b-6b03f94749ff None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:03:57.583024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:03:57.583664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:57.583938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:57.584208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:57.585028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] RBAC: Adding query filter params (role.id=07d102a3982549d699bb51ef80e43dd6, scope.project.id=974a10cf529746abaaf5b8430cc01156, user.id=d3b3524ba3d94d45ad789b39e0380b27) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:03:57.585370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:03:57.586852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b3b2f-f629-4ca5-8736-23f93b125717 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:03:57.593300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 643/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 20 09:03:57 2022] GET /identity/v3/role_assignments?user.id=d3b3524ba3d94d45ad789b39e0380b27&scope.project.id=974a10cf529746abaaf5b8430cc01156&role.id=07d102a3982549d699bb51ef80e43dd6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:03:59.918860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c9ff1-d2c8-4ddc-8844-6cd3ed2fb7b8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:59.919448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c9ff1-d2c8-4ddc-8844-6cd3ed2fb7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:59.919688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c9ff1-d2c8-4ddc-8844-6cd3ed2fb7b8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:59.921257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 645/1288] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:03:59.927822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c39556-097b-4a65-93d7-be559070c982 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:03:59.928575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c39556-097b-4a65-93d7-be559070c982 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:03:59.928694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c39556-097b-4a65-93d7-be559070c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:03:59.951360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-06c39556-097b-4a65-93d7-be559070c982 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:03:59.952584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-06c39556-097b-4a65-93d7-be559070c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:03:59.986473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:00.029548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 644/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:03:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:04:00.055458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c9ff1-d2c8-4ddc-8844-6cd3ed2fb7b8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:00.167385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c9ff1-d2c8-4ddc-8844-6cd3ed2fb7b8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:00.179624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:00.210886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:00.211691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:00.211960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:00.212231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:00.212897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:00.214307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:04:00.226875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:04:00.228072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:00.228922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 646/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:04:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:04:00.236835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c39556-097b-4a65-93d7-be559070c982 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:00.354886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c39556-097b-4a65-93d7-be559070c982 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:00.396050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:00.396713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:00.396990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:00.397278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:00.398011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:04:00.398314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:00.399723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41abde-05b3-4542-9125-a60e3acdcbe6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:00.405250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 645/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 20 09:04:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:04:00.414821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:00.532741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b8a0c-b6d1-4882-b832-3980d85da334 None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:00.569630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:00.570278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:00.570561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:00.570832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] PATH_INFO: `/v3/services` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:00.571549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:04:00.571859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:00.573275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55ea5-2fc7-45aa-b647-3932d1eb230d None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:00.578817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 647/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 20 09:04:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:04:02.602833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e846bb-9e98-45ed-b5f1-84ca2f811dfc None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:02.603570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e846bb-9e98-45ed-b5f1-84ca2f811dfc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:02.603570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e846bb-9e98-45ed-b5f1-84ca2f811dfc None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:02.604818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 646/1293] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:04:02.611433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671e38-d029-40e3-ad39-ecaa2d2d7948 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:02.612117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671e38-d029-40e3-ad39-ecaa2d2d7948 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:02.612324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671e38-d029-40e3-ad39-ecaa2d2d7948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:02.639637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-71671e38-d029-40e3-ad39-ecaa2d2d7948 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:04:02.640833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-71671e38-d029-40e3-ad39-ecaa2d2d7948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:04:02.678248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:02.718907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 648/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:04:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:04:02.742376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e846bb-9e98-45ed-b5f1-84ca2f811dfc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:02.776867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:02.858351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e846bb-9e98-45ed-b5f1-84ca2f811dfc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:02.896960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474c893-c083-4fa2-8782-8018c17ce08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:02.897652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c893-c083-4fa2-8782-8018c17ce08e None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:02.897930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c893-c083-4fa2-8782-8018c17ce08e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:02.898201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c893-c083-4fa2-8782-8018c17ce08e None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:02.898950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c893-c083-4fa2-8782-8018c17ce08e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:02.900323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c893-c083-4fa2-8782-8018c17ce08e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:02.917427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 647/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 20 09:04:02 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:04:04.966201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88284-44da-409d-9d43-a425dd3f31bd None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:04.967066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88284-44da-409d-9d43-a425dd3f31bd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:04.967483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88284-44da-409d-9d43-a425dd3f31bd None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:04.970211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 649/1296] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:04:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:04:04.979352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:04.979780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:04.979914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:04.999174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:04:05.009528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:04:05.087923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 648/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:04:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:04:05.111972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88284-44da-409d-9d43-a425dd3f31bd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:05.226290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88284-44da-409d-9d43-a425dd3f31bd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:05.261357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:05.262148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:05.262425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:05.262754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:05.263545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:05.264955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:04:05.277053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:04:05.278346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:05.284296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 650/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:04:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:04:05.285264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:05.304840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:05.399144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a875-77f3-43bd-888b-f5f3e61c5ae7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:05.436376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:05.437069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:05.437392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:05.437661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:05.438372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:04:05.438679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:05.440065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:05.445993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 649/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 20 09:04:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:04:05.452156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:05.485446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:05.556468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001e75-7699-47d1-a38d-feffe77d5bdd None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:05.591930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:05.592573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:05.592850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:05.593120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:05.593929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] RBAC: Adding query filter params (interface=public, service_id=2a0fe7a41faa4800b260ec20ebb682af, region_id=RegionOne) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:04:05.594235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:05.595597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94bb31-cb22-4af0-a02f-4ed0393abb61 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:05.601138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 651/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 20 09:04:05 2022] GET /identity/v3/endpoints?service_id=2a0fe7a41faa4800b260ec20ebb682af&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:04:05.607454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:05.695726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:05.716544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2cf7-8b27-4276-913c-c14ae3fae062 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:05.754711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3bcfe-2ef6-4282-93cc-a457a5c0111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:05.755307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3bcfe-2ef6-4282-93cc-a457a5c0111d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:05.755587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3bcfe-2ef6-4282-93cc-a457a5c0111d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:05.755857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3bcfe-2ef6-4282-93cc-a457a5c0111d None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:05.756532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3bcfe-2ef6-4282-93cc-a457a5c0111d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:05.757945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3bcfe-2ef6-4282-93cc-a457a5c0111d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:05.765443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 650/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 20 09:04:05 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:04:07.863543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c74d-cb35-451a-8cdf-f85447066ea0 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:07.864152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c74d-cb35-451a-8cdf-f85447066ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:07.864245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c74d-cb35-451a-8cdf-f85447066ea0 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:07.866428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 652/1302] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:04:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:04:07.874369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:07.874825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:07.874916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:07.893520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:04:07.894684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:04:07.966968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 651/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:04:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:04:07.990890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c74d-cb35-451a-8cdf-f85447066ea0 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:08.106781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:08.116050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c74d-cb35-451a-8cdf-f85447066ea0 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:08.155908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:08.156699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:08.156968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:08.157295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:08.157911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:08.159258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:04:08.171389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:04:08.172713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application with Lock( Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: ERROR keystone.server.flask.application Jul 20 09:04:08.174534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 653/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 20 09:04:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:04:08.181680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:08.268281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:08.292657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730ebeb-fd1c-47b1-aed7-d43f3fb866a6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:08.332796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:08.333489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:08.333763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:08.334032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:08.334733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] RBAC: Adding query filter params (name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:04:08.335040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:08.336415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff123b1-e4e4-400a-887d-63e65284d1be None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:08.342142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 652/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 20 09:04:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:04:08.348354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:04:08.462800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc702b8-1e4e-4a75-ae47-5a265768b06f None admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:04:08.499930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb93e4-63d2-40c4-b561-1bf455e0eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:04:08.500599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb93e4-63d2-40c4-b561-1bf455e0eae8 None admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:04:08.500876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb93e4-63d2-40c4-b561-1bf455e0eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:04:08.501144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb93e4-63d2-40c4-b561-1bf455e0eae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:04:08.501919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb93e4-63d2-40c4-b561-1bf455e0eae8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:04:08.503353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb93e4-63d2-40c4-b561-1bf455e0eae8 None admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:04:08.524578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 654/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 20 09:04:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:04:18.338752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=30 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:04:18.520247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:12.526919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e62c2-5045-4dff-87bd-3b740f21250f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:12.527483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e62c2-5045-4dff-87bd-3b740f21250f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:12.527483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e62c2-5045-4dff-87bd-3b740f21250f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:12.534432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72d13-bd0c-4385-abf4-b5df7307c2a1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:12.534893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72d13-bd0c-4385-abf4-b5df7307c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:12.534987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72d13-bd0c-4385-abf4-b5df7307c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:12.538286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 653/1307] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:12.648432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-41c72d13-bd0c-4385-abf4-b5df7307c2a1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:12.650712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-41c72d13-bd0c-4385-abf4-b5df7307c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:12.850730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 655/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:12.909630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0086c0-62f3-4fe4-aeba-ec6a5dfb03ff None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:12.909919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0086c0-62f3-4fe4-aeba-ec6a5dfb03ff None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:12.910195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0086c0-62f3-4fe4-aeba-ec6a5dfb03ff None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:12.911787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 654/1309] 10.222.0.67 () {54 vars in 965 bytes} [Wed Jul 20 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:12.918405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cacb69-6883-4861-a058-0696de036beb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:12.918746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cacb69-6883-4861-a058-0696de036beb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:12.919046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cacb69-6883-4861-a058-0696de036beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:13.001331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a8cacb69-6883-4861-a058-0696de036beb None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:13.002607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a8cacb69-6883-4861-a058-0696de036beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:13.024711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:13.089741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 656/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Jul 20 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:13.099976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0086c0-62f3-4fe4-aeba-ec6a5dfb03ff None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:13.101973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4b0086c0-62f3-4fe4-aeba-ec6a5dfb03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:13.216417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0086c0-62f3-4fe4-aeba-ec6a5dfb03ff None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:13.297760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:13.298333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:13.298711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:13.299074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:13.301017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:13.361014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:13.419277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:13.420873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6be6b-ac6c-4aee-8a23-b23d770855bf service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:13.440817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 655/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:15.798875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a9e92-ebc9-4765-a6ef-05697e4a3dac None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:15.799519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a9e92-ebc9-4765-a6ef-05697e4a3dac None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:15.799519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a9e92-ebc9-4765-a6ef-05697e4a3dac None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:15.800868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 657/1312] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:15.806866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26b3f3-a831-43a7-92f3-283fea10d566 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:15.807471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26b3f3-a831-43a7-92f3-283fea10d566 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:15.807471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26b3f3-a831-43a7-92f3-283fea10d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:15.893324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0f26b3f3-a831-43a7-92f3-283fea10d566 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:15.894839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0f26b3f3-a831-43a7-92f3-283fea10d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:16.007632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 656/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:16.047635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a9e92-ebc9-4765-a6ef-05697e4a3dac None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:16.049522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-890a9e92-ebc9-4765-a6ef-05697e4a3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:16.160406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a9e92-ebc9-4765-a6ef-05697e4a3dac None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:16.241073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:16.243925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:16.244678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:16.245151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:16.245507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:16.248139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:16.361783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:16.363118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4ba2-2266-4df6-96aa-2711f5dad56c service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:16.382645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 658/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:18.773883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb2c6-f618-4a45-a509-028e656cf28d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:18.774768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb2c6-f618-4a45-a509-028e656cf28d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:18.774768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb2c6-f618-4a45-a509-028e656cf28d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:18.776958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 657/1315] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:18.783926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9eb68-d10f-47ac-92b4-6cee8aa719bf None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:18.784375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9eb68-d10f-47ac-92b4-6cee8aa719bf None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:18.784466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9eb68-d10f-47ac-92b4-6cee8aa719bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:18.862284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1ee9eb68-d10f-47ac-92b4-6cee8aa719bf None None] MFA Rules not processed for user `f9773ed50bea40ed89ae85fd5125064d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:18.863519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1ee9eb68-d10f-47ac-92b4-6cee8aa719bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:18.931060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:18.978386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 659/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:19.025616 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb2c6-f618-4a45-a509-028e656cf28d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:19.027150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c4fbb2c6-f618-4a45-a509-028e656cf28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:19.037855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:19.147046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb2c6-f618-4a45-a509-028e656cf28d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:19.227684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:19.228494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:19.228815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:19.229109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:19.231630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:19.299337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:19.348868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:19.350359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7468aae-2e10-4404-a887-d45f8b7386a3 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:19.370599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 658/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:22.014010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327272-967a-4344-812d-24933a3ffc66 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:22.014912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327272-967a-4344-812d-24933a3ffc66 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:22.014912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327272-967a-4344-812d-24933a3ffc66 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:22.017099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 660/1318] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:22.025919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc752-7fc1-4a74-9062-daf65ec46671 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:22.026609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc752-7fc1-4a74-9062-daf65ec46671 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:22.026752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc752-7fc1-4a74-9062-daf65ec46671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:22.097840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-74fbc752-7fc1-4a74-9062-daf65ec46671 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:22.099475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-74fbc752-7fc1-4a74-9062-daf65ec46671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:22.218357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 659/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:22.273829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf3e6-9ab8-475d-91df-be22aae081d2 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:22.274016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf3e6-9ab8-475d-91df-be22aae081d2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:22.274278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf3e6-9ab8-475d-91df-be22aae081d2 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:22.275672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 661/1320] 10.222.0.67 () {54 vars in 965 bytes} [Wed Jul 20 09:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:22.284478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221c872-a4f5-48a4-9e0e-8c7ae05eb855 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:22.284763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221c872-a4f5-48a4-9e0e-8c7ae05eb855 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:22.285037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221c872-a4f5-48a4-9e0e-8c7ae05eb855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:22.308230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:22.363839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4221c872-a4f5-48a4-9e0e-8c7ae05eb855 None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:22.365098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4221c872-a4f5-48a4-9e0e-8c7ae05eb855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:22.442428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 660/1321] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Jul 20 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:22.451734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf3e6-9ab8-475d-91df-be22aae081d2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:22.453276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-33cdf3e6-9ab8-475d-91df-be22aae081d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:22.571847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf3e6-9ab8-475d-91df-be22aae081d2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:22.645834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:22.646471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:22.646736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:22.646995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:22.648800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:22.656312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:22.762163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:22.763596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5306446-b88d-4fe3-aaf4-7fe90491bfd6 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:22.783053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 662/1322] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:26.001831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db4af-4f1f-4550-b287-6644e7c5935d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:26.002406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db4af-4f1f-4550-b287-6644e7c5935d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:26.002406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db4af-4f1f-4550-b287-6644e7c5935d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:26.003780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 661/1323] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:26.009119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404958e-2b61-44ad-af42-8045b4e3d6f8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:26.009613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404958e-2b61-44ad-af42-8045b4e3d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:26.009736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404958e-2b61-44ad-af42-8045b4e3d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:26.077700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9404958e-2b61-44ad-af42-8045b4e3d6f8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:26.079016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9404958e-2b61-44ad-af42-8045b4e3d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:26.148061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:26.196323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 663/1324] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:26.234820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db4af-4f1f-4550-b287-6644e7c5935d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:26.237162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6f4db4af-4f1f-4550-b287-6644e7c5935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:26.358476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db4af-4f1f-4550-b287-6644e7c5935d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:26.371228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:26.435497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:26.436146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:26.436436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:26.436692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:26.438368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:26.549932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:26.551384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c3d84-ce35-439b-b183-e5bf566c0039 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:26.571240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 662/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:28.654136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa527-18a8-4f5e-8ce3-d8023545b79d None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:28.654717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa527-18a8-4f5e-8ce3-d8023545b79d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:28.654717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa527-18a8-4f5e-8ce3-d8023545b79d None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:28.656009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 664/1326] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:28.661396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc424-8c7b-4280-830b-261dab245cd2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:28.661828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc424-8c7b-4280-830b-261dab245cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:28.661944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc424-8c7b-4280-830b-261dab245cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:28.711718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:28.732196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4bedc424-8c7b-4280-830b-261dab245cd2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:28.734105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4bedc424-8c7b-4280-830b-261dab245cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:28.838827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 663/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:28.876478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa527-18a8-4f5e-8ce3-d8023545b79d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:28.878100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a43fa527-18a8-4f5e-8ce3-d8023545b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:28.988140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa527-18a8-4f5e-8ce3-d8023545b79d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:29.071329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:29.071988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:29.072268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:29.072521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:29.074405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:29.092730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:29.191064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:29.192526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e42f-5c10-43f3-aca0-289636fe1c19 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:29.212627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 665/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:31.316402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4a65-7f40-4675-943f-cb5b2056b138 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:31.316930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4a65-7f40-4675-943f-cb5b2056b138 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:31.316930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4a65-7f40-4675-943f-cb5b2056b138 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:31.318373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 664/1329] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:31.323857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5557b-4149-490c-8a56-b0db44f0e0db None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:31.324606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5557b-4149-490c-8a56-b0db44f0e0db None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:31.324606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5557b-4149-490c-8a56-b0db44f0e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:31.395922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f7e5557b-4149-490c-8a56-b0db44f0e0db None None] MFA Rules not processed for user `f9773ed50bea40ed89ae85fd5125064d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:31.397146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f7e5557b-4149-490c-8a56-b0db44f0e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:31.463849 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:31.502972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 666/1330] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:31.540737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4a65-7f40-4675-943f-cb5b2056b138 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:31.542388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2a7d4a65-7f40-4675-943f-cb5b2056b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:31.650912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4a65-7f40-4675-943f-cb5b2056b138 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:31.672393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:31.729062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:31.729736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:31.730062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:31.730463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:31.732028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:31.850839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:31.852404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16232ee-e0a7-490f-8a48-9b89fc97cf43 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:31.879969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 665/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:34.191310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c383-04c6-43ca-a862-b98facada6fc None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:34.196537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c383-04c6-43ca-a862-b98facada6fc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:34.197005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c383-04c6-43ca-a862-b98facada6fc None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:34.199752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 667/1332] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:34.205625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f464c-cf8b-4d2e-b3f1-00b088ffc58f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:34.206112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f464c-cf8b-4d2e-b3f1-00b088ffc58f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:34.206112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f464c-cf8b-4d2e-b3f1-00b088ffc58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:34.279742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:34.284946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-944f464c-cf8b-4d2e-b3f1-00b088ffc58f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:34.286292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-944f464c-cf8b-4d2e-b3f1-00b088ffc58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:34.387490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 666/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:34.427386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c383-04c6-43ca-a862-b98facada6fc None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:34.429991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a4d1c383-04c6-43ca-a862-b98facada6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:34.554087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c383-04c6-43ca-a862-b98facada6fc None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:34.632842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:34.633536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:34.633812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:34.634086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:34.635775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:34.665638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:34.760425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:34.762164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ed649-3d03-4df3-9967-bd265b21639d service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:34.783845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 668/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:36.893883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00188685-7df8-44ad-9236-7d33878ea9d1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:36.894795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00188685-7df8-44ad-9236-7d33878ea9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:36.894795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00188685-7df8-44ad-9236-7d33878ea9d1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:36.896833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 667/1335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:36.904881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561d836-e40a-44df-a9fb-97d95696d865 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:36.905393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561d836-e40a-44df-a9fb-97d95696d865 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:36.905489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561d836-e40a-44df-a9fb-97d95696d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:36.973588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-0561d836-e40a-44df-a9fb-97d95696d865 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:36.974786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0561d836-e40a-44df-a9fb-97d95696d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:37.062690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:37.095056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 669/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:05:37.143670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00188685-7df8-44ad-9236-7d33878ea9d1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:37.145356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-00188685-7df8-44ad-9236-7d33878ea9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:37.261576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00188685-7df8-44ad-9236-7d33878ea9d1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:37.295125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:37.342402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:37.343054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:37.343344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:37.343604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:37.345324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:37.469340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:37.471028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336cbe4-0ddf-4b28-998d-1d6a1c7fb2a6 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:37.490872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 668/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:39.899897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfda7-dd3f-430d-b65b-cc72825c138f None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:39.900730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfda7-dd3f-430d-b65b-cc72825c138f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:39.900730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfda7-dd3f-430d-b65b-cc72825c138f None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:39.902583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 670/1338] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:39.911269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e286-fffb-4756-920d-e9c1169a9883 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:39.911693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e286-fffb-4756-920d-e9c1169a9883 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:39.911935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e286-fffb-4756-920d-e9c1169a9883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:39.984497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2b19e286-fffb-4756-920d-e9c1169a9883 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:39.985747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b19e286-fffb-4756-920d-e9c1169a9883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:39.994367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:40.089365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 669/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:40.126606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bfda7-dd3f-430d-b65b-cc72825c138f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:40.128144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d06bfda7-dd3f-430d-b65b-cc72825c138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:40.280759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bfda7-dd3f-430d-b65b-cc72825c138f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:40.374056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:40.374714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:40.374993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:40.375262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:40.376965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:40.421206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:40.502451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:40.503799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde158d7-83ff-4f37-b39f-9e5906f29e8e service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:40.522358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 671/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:44.661064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ad2f6-a18c-4c79-ae08-fcec01d998a9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:44.661652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ad2f6-a18c-4c79-ae08-fcec01d998a9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:44.661652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ad2f6-a18c-4c79-ae08-fcec01d998a9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:44.663016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 670/1341] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:44.668669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc3aa9-6ef0-4eea-9f79-9c94e5959684 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:44.669140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc3aa9-6ef0-4eea-9f79-9c94e5959684 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:44.669140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc3aa9-6ef0-4eea-9f79-9c94e5959684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:44.736752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a4dc3aa9-6ef0-4eea-9f79-9c94e5959684 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:44.738024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a4dc3aa9-6ef0-4eea-9f79-9c94e5959684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:44.829922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:44.842410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 672/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:44.882726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ad2f6-a18c-4c79-ae08-fcec01d998a9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:44.884315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-da4ad2f6-a18c-4c79-ae08-fcec01d998a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:44.993759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ad2f6-a18c-4c79-ae08-fcec01d998a9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:45.033309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:45.073772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:45.074448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:45.074729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:45.075004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:45.076703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:45.190835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:45.192289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004e229-3a06-4595-81bd-758aeddcdb4d service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:45.211749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 671/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:47.903824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78eb7-8450-458f-b453-3036b7ea5c48 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:47.904447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78eb7-8450-458f-b453-3036b7ea5c48 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:47.904447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78eb7-8450-458f-b453-3036b7ea5c48 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:47.905820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 673/1344] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:05:47.911933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240300-8485-4a9c-b48f-2d0bc8df8790 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:47.912509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240300-8485-4a9c-b48f-2d0bc8df8790 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:47.912509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240300-8485-4a9c-b48f-2d0bc8df8790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:47.989217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a240300-8485-4a9c-b48f-2d0bc8df8790 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:47.990475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a240300-8485-4a9c-b48f-2d0bc8df8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:48.011607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:48.104072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 672/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:48.141566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a78eb7-8450-458f-b453-3036b7ea5c48 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:48.143116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a0a78eb7-8450-458f-b453-3036b7ea5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:48.255788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a78eb7-8450-458f-b453-3036b7ea5c48 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:48.336250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:48.336824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:48.337097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:48.337391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:48.339139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:48.384954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:48.454481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:48.455933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4705d2e-c2ba-4e4e-8789-77fdfe6bc478 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:48.476759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 674/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:52.673115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8876e9-25cd-4566-a43d-1af915f310d0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:52.673610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8876e9-25cd-4566-a43d-1af915f310d0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:52.673811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8876e9-25cd-4566-a43d-1af915f310d0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:52.675355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 673/1347] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:52.687955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c12b-1056-4ad7-adb2-394fe6dc727b None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:52.688410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c12b-1056-4ad7-adb2-394fe6dc727b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:52.688498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c12b-1056-4ad7-adb2-394fe6dc727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:52.775689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-dde4c12b-1056-4ad7-adb2-394fe6dc727b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:52.776985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dde4c12b-1056-4ad7-adb2-394fe6dc727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:52.877010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:52.880152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 675/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:05:52.919836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8876e9-25cd-4566-a43d-1af915f310d0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:05:52.921404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6d8876e9-25cd-4566-a43d-1af915f310d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:53.034211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8876e9-25cd-4566-a43d-1af915f310d0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:05:53.087047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:53.115388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:05:53.116151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:53.116440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:53.116708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:53.118423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:53.237326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:05:53.238762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a4461-bc05-4012-9bf3-e0a6795f3729 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:05:53.258977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 674/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:05:58.332659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd90b8-8e6a-42f7-9e63-5f22c4adc8ac None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:58.333191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd90b8-8e6a-42f7-9e63-5f22c4adc8ac None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:58.334216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd90b8-8e6a-42f7-9e63-5f22c4adc8ac None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:58.335666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 676/1350] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:05:58.342163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ed1a-43c1-44a7-a96b-0c8604dc3345 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:05:58.343131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ed1a-43c1-44a7-a96b-0c8604dc3345 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:05:58.343131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ed1a-43c1-44a7-a96b-0c8604dc3345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:05:58.459124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8402ed1a-43c1-44a7-a96b-0c8604dc3345 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:05:58.460810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8402ed1a-43c1-44a7-a96b-0c8604dc3345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:05:58.497671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:58.582587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 675/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:05:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:06:02.962587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc206ea-10dc-446c-8cb4-9ec7625639b8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:02.963495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc206ea-10dc-446c-8cb4-9ec7625639b8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:02.963794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc206ea-10dc-446c-8cb4-9ec7625639b8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:02.965498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 677/1352] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:02.971591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11d136-2300-4c54-8100-5f8214fa0f58 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:02.972443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11d136-2300-4c54-8100-5f8214fa0f58 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:02.972982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11d136-2300-4c54-8100-5f8214fa0f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:03.060666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ec11d136-2300-4c54-8100-5f8214fa0f58 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:03.062353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ec11d136-2300-4c54-8100-5f8214fa0f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:03.144059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:03.183386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 676/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:06:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:04.307214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d12bf-2e29-4e40-a14d-b65df324a87e None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:04.307760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d12bf-2e29-4e40-a14d-b65df324a87e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:04.307760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d12bf-2e29-4e40-a14d-b65df324a87e None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:04.309367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 678/1354] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:04.314389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fd42-4fa7-417b-92bf-d708fe6a9021 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:04.314893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fd42-4fa7-417b-92bf-d708fe6a9021 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:04.314992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fd42-4fa7-417b-92bf-d708fe6a9021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:04.393409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d5d8fd42-4fa7-417b-92bf-d708fe6a9021 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:04.394629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d5d8fd42-4fa7-417b-92bf-d708fe6a9021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:04.504612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 677/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:06:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:07.970080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b499-4a0f-45da-a34b-417cf86c267f None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:07.970598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b499-4a0f-45da-a34b-417cf86c267f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:07.971323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b499-4a0f-45da-a34b-417cf86c267f None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:07.972925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 679/1356] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:07.979092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e670-014a-4606-8df5-537a824b4145 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:07.979568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e670-014a-4606-8df5-537a824b4145 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:07.979883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e670-014a-4606-8df5-537a824b4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:08.024031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:08.066364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-33f8e670-014a-4606-8df5-537a824b4145 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:08.067592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-33f8e670-014a-4606-8df5-537a824b4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:08.172745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 678/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:08.231264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d7ae-07a2-4698-9ed2-a0ca045caa03 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:08.231885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d7ae-07a2-4698-9ed2-a0ca045caa03 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:08.232403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d7ae-07a2-4698-9ed2-a0ca045caa03 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:08.234553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 680/1358] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 20 09:06:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:08.247172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465a48-d4ba-436b-980d-c65da4a2064b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:08.247475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465a48-d4ba-436b-980d-c65da4a2064b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:08.247694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465a48-d4ba-436b-980d-c65da4a2064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:08.343787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-25465a48-d4ba-436b-980d-c65da4a2064b None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:08.345356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-25465a48-d4ba-436b-980d-c65da4a2064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:08.399743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:08.475796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 679/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 20 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:08.483919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23d7ae-07a2-4698-9ed2-a0ca045caa03 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:08.485469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1a23d7ae-07a2-4698-9ed2-a0ca045caa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:08.652632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23d7ae-07a2-4698-9ed2-a0ca045caa03 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:08.741345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:08.796181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:08.796846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:08.797126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:08.797444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:08.799088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:08.895814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:08.897484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b9809-2951-4137-b070-a67d1d5dda85 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:08.916639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 681/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:11.219646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061147-36b4-4bf2-870f-f6e9ec28665e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:11.220224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061147-36b4-4bf2-870f-f6e9ec28665e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:11.220224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061147-36b4-4bf2-870f-f6e9ec28665e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:11.221859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 680/1361] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:11.227098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8256-4d8d-428c-89bc-ba61fdc3ce75 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:11.227583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8256-4d8d-428c-89bc-ba61fdc3ce75 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:11.227695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8256-4d8d-428c-89bc-ba61fdc3ce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:11.306475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-59af8256-4d8d-428c-89bc-ba61fdc3ce75 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:11.307756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-59af8256-4d8d-428c-89bc-ba61fdc3ce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:11.357052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:11.437488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 682/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:11.486717 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061147-36b4-4bf2-870f-f6e9ec28665e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:11.488398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1a061147-36b4-4bf2-870f-f6e9ec28665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:11.688780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061147-36b4-4bf2-870f-f6e9ec28665e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:11.700199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:11.828729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:11.830068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:11.830461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:11.830738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:11.832468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:11.929980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:11.931579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580cb37-f098-4a69-bbb6-67a84850d77f service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:11.951511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 681/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:14.347726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a7fb-9c29-4394-98c7-d0415d9c3525 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:14.348637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a7fb-9c29-4394-98c7-d0415d9c3525 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:14.348962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a7fb-9c29-4394-98c7-d0415d9c3525 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:14.350856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 683/1364] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:14.356633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0c39a-99fc-4e84-9ea7-d24174b70182 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:14.357097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0c39a-99fc-4e84-9ea7-d24174b70182 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:14.357358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0c39a-99fc-4e84-9ea7-d24174b70182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:14.372973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:14.429533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3da0c39a-99fc-4e84-9ea7-d24174b70182 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:14.430759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3da0c39a-99fc-4e84-9ea7-d24174b70182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:14.535519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 682/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:06:14.586063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3768e4-9de4-467d-8887-985e269db46b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:14.586513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3768e4-9de4-467d-8887-985e269db46b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:14.586875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3768e4-9de4-467d-8887-985e269db46b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:14.589380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 684/1366] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 20 09:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:14.595575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d97b-07da-4b0b-b4a4-25182b595ff2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:14.595788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d97b-07da-4b0b-b4a4-25182b595ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:14.596192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d97b-07da-4b0b-b4a4-25182b595ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:14.679845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4877d97b-07da-4b0b-b4a4-25182b595ff2 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:14.682114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4877d97b-07da-4b0b-b4a4-25182b595ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:14.724275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:14.818263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 683/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 20 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:14.826952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3768e4-9de4-467d-8887-985e269db46b None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:14.828607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cf3768e4-9de4-467d-8887-985e269db46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:14.985537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3768e4-9de4-467d-8887-985e269db46b None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:15.007208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:15.107407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:15.107958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:15.108237 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:15.108623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:15.110306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:15.207542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:15.209180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e26d3-a434-4137-9e8d-b2d75257a100 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:15.230346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 685/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:16.188016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5f4c-2c67-4533-b91d-4f08aca264ac None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:16.188614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5f4c-2c67-4533-b91d-4f08aca264ac None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:16.188614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5f4c-2c67-4533-b91d-4f08aca264ac None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:16.193894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 684/1369] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:16.195786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c994-967a-4954-8766-b57a5601f10c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:16.196209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c994-967a-4954-8766-b57a5601f10c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:16.196357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c994-967a-4954-8766-b57a5601f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:16.231382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:16.272819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1b14c994-967a-4954-8766-b57a5601f10c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:16.274194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1b14c994-967a-4954-8766-b57a5601f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:16.387284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 686/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:16.707247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1d53-08c0-4c49-aac3-6b4f37f14c52 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:16.707839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1d53-08c0-4c49-aac3-6b4f37f14c52 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:16.708290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1d53-08c0-4c49-aac3-6b4f37f14c52 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:16.709956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 685/1371] 10.222.0.67 () {54 vars in 964 bytes} [Wed Jul 20 09:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:16.716136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283d7c-3023-4c21-9d51-ce93b37422c2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:16.716524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283d7c-3023-4c21-9d51-ce93b37422c2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:16.716953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283d7c-3023-4c21-9d51-ce93b37422c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:16.799052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-27283d7c-3023-4c21-9d51-ce93b37422c2 None None] MFA Rules not processed for user `264ac709e4744acdaf774ab52c165862`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:16.800567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-27283d7c-3023-4c21-9d51-ce93b37422c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:16.850573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:16.882866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 687/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Jul 20 09:06:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:16.890691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1d53-08c0-4c49-aac3-6b4f37f14c52 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:16.892267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-182c1d53-08c0-4c49-aac3-6b4f37f14c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:17.003967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1d53-08c0-4c49-aac3-6b4f37f14c52 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:17.048215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:17.085195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:17.085890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:17.086171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:17.086444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:17.088129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:17.216735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:17.218241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69bdf-174a-4bc5-84f1-20d7e52b16a3 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:17.241186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 686/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:17.361780 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec611db-f937-4982-8dc8-316f8e621e44 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:17.362226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec611db-f937-4982-8dc8-316f8e621e44 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:17.362848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec611db-f937-4982-8dc8-316f8e621e44 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:17.365206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 688/1374] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:17.370259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9404a-beba-4fec-a85f-bf7aced71040 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:17.370552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9404a-beba-4fec-a85f-bf7aced71040 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:17.370826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9404a-beba-4fec-a85f-bf7aced71040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:17.436574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f3f9404a-beba-4fec-a85f-bf7aced71040 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:17.437780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f3f9404a-beba-4fec-a85f-bf7aced71040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:17.458944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:17.545531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 687/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:17.587443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec611db-f937-4982-8dc8-316f8e621e44 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:17.589392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6ec611db-f937-4982-8dc8-316f8e621e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:17.736642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec611db-f937-4982-8dc8-316f8e621e44 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:17.790298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:17.856894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:17.857583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:17.857863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:17.858141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:17.860023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:17.954861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:17.956474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aad57-4ee6-494c-b058-7fbf3f6a9dd0 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:17.975472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 689/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:20.059089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21128e-44ab-4d3a-ab23-3c99f29944e9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:20.059629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21128e-44ab-4d3a-ab23-3c99f29944e9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:20.059629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21128e-44ab-4d3a-ab23-3c99f29944e9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:20.061031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 688/1377] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:20.066675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0794-b4e1-4f84-84b0-44a42b89a337 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:20.067082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0794-b4e1-4f84-84b0-44a42b89a337 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:20.067301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0794-b4e1-4f84-84b0-44a42b89a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:20.134622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-039e0794-b4e1-4f84-84b0-44a42b89a337 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:20.135801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-039e0794-b4e1-4f84-84b0-44a42b89a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:20.142685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:20.243638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 690/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:20.304562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21128e-44ab-4d3a-ab23-3c99f29944e9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:20.307147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bc21128e-44ab-4d3a-ab23-3c99f29944e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:20.476572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21128e-44ab-4d3a-ab23-3c99f29944e9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:20.480292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:20.596402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:20.597084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:20.597385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:20.597657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:20.599314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:20.705638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:20.707275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891e7bd-b920-4539-a645-f2b9831cef15 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:20.726359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 689/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:22.850793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510017ac-26b4-4b2b-b306-89d89010f508 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:22.851384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510017ac-26b4-4b2b-b306-89d89010f508 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:22.851384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510017ac-26b4-4b2b-b306-89d89010f508 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:22.852776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 691/1380] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:22.859969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03127f46-16bc-4a74-a74f-f7607dcd306e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:22.860555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03127f46-16bc-4a74-a74f-f7607dcd306e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:22.860555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03127f46-16bc-4a74-a74f-f7607dcd306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:22.872839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:22.937001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-03127f46-16bc-4a74-a74f-f7607dcd306e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:22.938270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-03127f46-16bc-4a74-a74f-f7607dcd306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:23.045110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 690/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:23.089159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510017ac-26b4-4b2b-b306-89d89010f508 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:23.090681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-510017ac-26b4-4b2b-b306-89d89010f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:23.237876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:23.250413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510017ac-26b4-4b2b-b306-89d89010f508 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:23.377355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:23.378007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:23.378363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:23.378697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:23.380503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:23.477273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:23.479249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616d52-9851-491e-95c6-819ceecf4fe0 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:23.490139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:23.505417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 692/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:25.678239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f6753-b335-47ed-92fc-c93ae3a6d20e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:25.678922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f6753-b335-47ed-92fc-c93ae3a6d20e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:25.678922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f6753-b335-47ed-92fc-c93ae3a6d20e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:25.680299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 691/1383] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:25.686404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e58f46-b1b9-4e97-bb26-25b603b4ac2a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:25.686889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e58f46-b1b9-4e97-bb26-25b603b4ac2a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:25.687003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e58f46-b1b9-4e97-bb26-25b603b4ac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:25.766444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-46e58f46-b1b9-4e97-bb26-25b603b4ac2a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:25.767751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-46e58f46-b1b9-4e97-bb26-25b603b4ac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:25.886246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 693/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:25.932637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f6753-b335-47ed-92fc-c93ae3a6d20e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:25.934072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-554f6753-b335-47ed-92fc-c93ae3a6d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:26.045193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:26.124733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f6753-b335-47ed-92fc-c93ae3a6d20e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:26.260837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:26.261650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:26.261944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:26.262218 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:26.264007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:26.320415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:26.362875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:26.364606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549341-e6f9-457b-9089-43b2c595a5dd service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:26.386297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 692/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:28.448447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3ed9-4235-4387-8db2-fe741f1b4def None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:28.449531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3ed9-4235-4387-8db2-fe741f1b4def None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:28.449531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3ed9-4235-4387-8db2-fe741f1b4def None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:28.450783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 694/1386] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:28.457383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87573aa7-b911-425b-a1be-ff070b520a3a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:28.458053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87573aa7-b911-425b-a1be-ff070b520a3a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:28.458155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87573aa7-b911-425b-a1be-ff070b520a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:28.531005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-87573aa7-b911-425b-a1be-ff070b520a3a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:28.532142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-87573aa7-b911-425b-a1be-ff070b520a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:28.643099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 693/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:06:28.695723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a3ed9-4235-4387-8db2-fe741f1b4def None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:28.697917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-815a3ed9-4235-4387-8db2-fe741f1b4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:28.786990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:28.867397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a3ed9-4235-4387-8db2-fe741f1b4def None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:28.999742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:29.000427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:29.000707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:29.000980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:29.002780 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:29.044015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:29.098031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:29.099667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbbc06-5363-4435-8bd4-93c57fa4bc48 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:29.118041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 695/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:31.509761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e570-3586-4b7d-8af3-3fa45a4f7b55 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:31.509761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e570-3586-4b7d-8af3-3fa45a4f7b55 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:31.510680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e570-3586-4b7d-8af3-3fa45a4f7b55 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:31.511552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 694/1389] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:31.517480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e463-8dcd-4c46-b975-a2f4f5a7ac0d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:31.517940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e463-8dcd-4c46-b975-a2f4f5a7ac0d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:31.518060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e463-8dcd-4c46-b975-a2f4f5a7ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:31.596962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f040e463-8dcd-4c46-b975-a2f4f5a7ac0d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:31.598562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f040e463-8dcd-4c46-b975-a2f4f5a7ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:31.710735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 696/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:31.764380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1e570-3586-4b7d-8af3-3fa45a4f7b55 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:31.765931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c7f1e570-3586-4b7d-8af3-3fa45a4f7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:31.800217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:31.932625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1e570-3586-4b7d-8af3-3fa45a4f7b55 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:32.057055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:32.070691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:32.071387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:32.071708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:32.072041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:32.073807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:32.168666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:32.170598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fec76-0494-48ec-8744-ef8a413c3b93 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:32.192893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 695/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:34.280064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b86887-a02f-4dfe-abfa-966278c4bab7 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:34.280559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b86887-a02f-4dfe-abfa-966278c4bab7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:34.280559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b86887-a02f-4dfe-abfa-966278c4bab7 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:34.282026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 697/1392] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:34.288811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7aad9-13d4-4f00-a41b-e8cce714a6c5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:34.289315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7aad9-13d4-4f00-a41b-e8cce714a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:34.289636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7aad9-13d4-4f00-a41b-e8cce714a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:34.374850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-01f7aad9-13d4-4f00-a41b-e8cce714a6c5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:34.376135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-01f7aad9-13d4-4f00-a41b-e8cce714a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:34.448131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:34.498321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 696/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:34.548283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b86887-a02f-4dfe-abfa-966278c4bab7 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:34.549882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a4b86887-a02f-4dfe-abfa-966278c4bab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:34.564967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:34.711417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b86887-a02f-4dfe-abfa-966278c4bab7 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:34.803959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:34.833105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:34.833812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:34.834091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:34.834367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:34.836069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:34.930389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:34.932229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dce274-90be-47a9-9940-fff39a87d4ec service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:34.951878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 698/1394] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:37.038491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32e141-9457-47a3-a2a2-0e96c3a66cc6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:37.039236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32e141-9457-47a3-a2a2-0e96c3a66cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:37.039236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32e141-9457-47a3-a2a2-0e96c3a66cc6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:37.040440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 697/1395] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:37.046759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc8a9-8b41-46fc-865a-3b9e71d0fbab None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:37.047263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc8a9-8b41-46fc-865a-3b9e71d0fbab None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:37.047444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc8a9-8b41-46fc-865a-3b9e71d0fbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:37.119104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-18ebc8a9-8b41-46fc-865a-3b9e71d0fbab None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:37.120357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-18ebc8a9-8b41-46fc-865a-3b9e71d0fbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:37.172811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:37.222830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 699/1396] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:37.267593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32e141-9457-47a3-a2a2-0e96c3a66cc6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:37.269126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dd32e141-9457-47a3-a2a2-0e96c3a66cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:37.426839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32e141-9457-47a3-a2a2-0e96c3a66cc6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:37.476337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:37.547948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:37.548516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:37.548792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:37.549061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:37.550748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:37.643609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:37.645257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c9a6-d431-48ce-8bbe-e8b9356b0e4d service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:37.664229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 698/1397] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:38.147965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dff-e684-4ed6-9742-693d24843f24 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:38.148538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dff-e684-4ed6-9742-693d24843f24 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:38.148538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dff-e684-4ed6-9742-693d24843f24 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:38.150173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 700/1398] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:38.155578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e36a-bc1b-4bfe-86a4-43c7e52125fe None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:38.156036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e36a-bc1b-4bfe-86a4-43c7e52125fe None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:38.156137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e36a-bc1b-4bfe-86a4-43c7e52125fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:38.223826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6ce8e36a-bc1b-4bfe-86a4-43c7e52125fe None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:38.225024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6ce8e36a-bc1b-4bfe-86a4-43c7e52125fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:38.227115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:38.329402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 699/1399] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:38.386164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3209a0-46a3-49e3-9993-bdb08af6ad51 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:38.386452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3209a0-46a3-49e3-9993-bdb08af6ad51 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:38.386721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3209a0-46a3-49e3-9993-bdb08af6ad51 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:38.388139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 701/1400] 10.222.0.67 () {54 vars in 966 bytes} [Wed Jul 20 09:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:38.393487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a7b7-6f0a-4ebd-bff1-5055c8faab53 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:38.393777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a7b7-6f0a-4ebd-bff1-5055c8faab53 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:38.394048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a7b7-6f0a-4ebd-bff1-5055c8faab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:38.472534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-23f7a7b7-6f0a-4ebd-bff1-5055c8faab53 None None] MFA Rules not processed for user `f2d3b8154d784b779c87717947789ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:38.473742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-23f7a7b7-6f0a-4ebd-bff1-5055c8faab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:38.554898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:38.558882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 700/1401] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Jul 20 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:38.566427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3209a0-46a3-49e3-9993-bdb08af6ad51 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:38.567977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2b3209a0-46a3-49e3-9993-bdb08af6ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:38.674383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3209a0-46a3-49e3-9993-bdb08af6ad51 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:38.755462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:38.756126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:38.756404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:38.756720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:38.758538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:38.762078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:38.878284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:38.879725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3678353-3457-4eff-b979-e2553669fc73 service glance] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:38.899155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 702/1402] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:39.639344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190070-164a-4094-b283-23f9b4963127 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:39.639829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190070-164a-4094-b283-23f9b4963127 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:39.639932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190070-164a-4094-b283-23f9b4963127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:39.707912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b0190070-164a-4094-b283-23f9b4963127 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:39.709114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b0190070-164a-4094-b283-23f9b4963127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:39.763804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a0971-9605-467e-b57a-06a4a96fc492 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:39.764399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a0971-9605-467e-b57a-06a4a96fc492 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:39.764399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a0971-9605-467e-b57a-06a4a96fc492 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:39.765818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 703/1403] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:06:39.771110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:39.771390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:39.771649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:39.798506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 701/1404] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:06:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:06:39.843746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:39.844997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:39.846925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc4ea1-d22a-4fb2-86f4-98f81ae62ad0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:39.847221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc4ea1-d22a-4fb2-86f4-98f81ae62ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:39.847499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc4ea1-d22a-4fb2-86f4-98f81ae62ad0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:39.848924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 702/1405] 10.222.0.67 () {54 vars in 943 bytes} [Wed Jul 20 09:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:06:39.856246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:39.856374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:39.856648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:39.912787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:39.936068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] MFA Rules not processed for user `72c1b7dca4f0464c8f63394d348c95ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:06:39.937328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:39.970133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:40.062436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 703/1406] 10.222.0.67 () {58 vars in 1040 bytes} [Wed Jul 20 09:06:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:06:40.072994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:40.080244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 704/1407] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:06:40.083332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6905ecd-a499-44d0-a2a1-29b23cb1f9f0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:40.125510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:06:40.126762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:40.193422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:40.194036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:40.194293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:40.194561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:40.196265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:40.233050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:40.244542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235931a8-6bbe-46d3-bae3-774173d6b679 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:06:40.283535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:40.285162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d08c24-d0ac-42f7-8a88-e179a3b363ab service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:40.293904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 704/1408] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:06:40.321333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:40.374003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:06:40.374683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:06:40.374961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:06:40.375230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:06:40.376900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:06:40.491673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:06:40.493958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b939c1-ddf8-4f54-8d98-b7de45ed973e service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:06:40.512386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 705/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:50.290005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=23 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:50.510026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=64 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:02.709379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1cdd-fab5-4bb3-b023-3829bf2321b3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:02.710096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1cdd-fab5-4bb3-b023-3829bf2321b3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:02.710096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1cdd-fab5-4bb3-b023-3829bf2321b3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:02.711625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 705/1410] 10.222.0.67 () {54 vars in 918 bytes} [Wed Jul 20 09:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:02.717762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b663c7-4984-4655-9183-863e61da28f1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:02.718658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b663c7-4984-4655-9183-863e61da28f1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:02.718658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b663c7-4984-4655-9183-863e61da28f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:02.825451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-20b663c7-4984-4655-9183-863e61da28f1 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:02.827030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-20b663c7-4984-4655-9183-863e61da28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:02.963871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 706/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Jul 20 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:02.982317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a558-62cd-40e6-8fc8-668fd95bf312 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:02.982699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a558-62cd-40e6-8fc8-668fd95bf312 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:02.982950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a558-62cd-40e6-8fc8-668fd95bf312 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:02.984459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 706/1412] 10.222.0.67 () {54 vars in 918 bytes} [Wed Jul 20 09:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:02.989787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cbf74-cd3f-4784-99cf-6bb0e09995a2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:02.990064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cbf74-cd3f-4784-99cf-6bb0e09995a2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:02.990329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cbf74-cd3f-4784-99cf-6bb0e09995a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:03.098367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:03.102105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9e8cbf74-cd3f-4784-99cf-6bb0e09995a2 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:03.105683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9e8cbf74-cd3f-4784-99cf-6bb0e09995a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:03.246468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 707/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Jul 20 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:05.815074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda852-c334-455f-8be0-78a2cab8cbb6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:05.815969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda852-c334-455f-8be0-78a2cab8cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:05.815969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda852-c334-455f-8be0-78a2cab8cbb6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:05.818309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:05.823989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ab68-86d2-4c92-a00b-527d14e6058d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:05.824453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ab68-86d2-4c92-a00b-527d14e6058d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:05.824561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ab68-86d2-4c92-a00b-527d14e6058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:05.891885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b2c8ab68-86d2-4c92-a00b-527d14e6058d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:05.893081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b2c8ab68-86d2-4c92-a00b-527d14e6058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:05.956144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:06.002063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:06.049646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda852-c334-455f-8be0-78a2cab8cbb6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:06.051432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a9fda852-c334-455f-8be0-78a2cab8cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:06.205361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda852-c334-455f-8be0-78a2cab8cbb6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:06.283655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:06.326918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:06.327575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:06.327851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:06.328121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:06.329794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:06.424659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:06.426292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881d33-1bf8-431a-a91d-0ee7b9367f0f service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:06.445092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 708/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:07.371351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f304b-9138-4872-8e48-eca298c12dff None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:07.371951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f304b-9138-4872-8e48-eca298c12dff None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:07.372054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f304b-9138-4872-8e48-eca298c12dff None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:07.374653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:07.380939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0d4b-6b63-4e55-81cc-1c785e4de374 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:07.381776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0d4b-6b63-4e55-81cc-1c785e4de374 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:07.381925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0d4b-6b63-4e55-81cc-1c785e4de374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:07.467981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e79b0d4b-6b63-4e55-81cc-1c785e4de374 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:07.469537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e79b0d4b-6b63-4e55-81cc-1c785e4de374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:07.500256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:07.697654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:07.851825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f304b-9138-4872-8e48-eca298c12dff None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:07.853367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-fe8f304b-9138-4872-8e48-eca298c12dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:08.021144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f304b-9138-4872-8e48-eca298c12dff None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:08.075547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:08.150385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:08.150676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:08.150938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:08.151211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:08.152949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:08.248592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:08.250219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fbb1b-99d9-47a9-8a41-1ef7add571e5 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:08.270098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 710/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:09.177292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa7c0-afb8-43a8-aa65-8acde8ab29f6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:09.177873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa7c0-afb8-43a8-aa65-8acde8ab29f6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:09.177873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa7c0-afb8-43a8-aa65-8acde8ab29f6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:09.179226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:09.184666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c3f82-06e0-4d4e-a94a-dd99d6b26cb2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:09.185100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c3f82-06e0-4d4e-a94a-dd99d6b26cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:09.185212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c3f82-06e0-4d4e-a94a-dd99d6b26cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:09.240977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:09.270924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-898c3f82-06e0-4d4e-a94a-dd99d6b26cb2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:09.272155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-898c3f82-06e0-4d4e-a94a-dd99d6b26cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:09.372948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:09.529908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaa7c0-afb8-43a8-aa65-8acde8ab29f6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:09.531778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0eeaa7c0-afb8-43a8-aa65-8acde8ab29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:09.686463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaa7c0-afb8-43a8-aa65-8acde8ab29f6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:09.705503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:09.816848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:09.817530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:09.817809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:09.818076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:09.819742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:09.917010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:09.919112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74588-e3e9-4efb-8b37-51e53acf1daa service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:09.939023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 711/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:10.818756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5466-8ecf-44ef-8ded-1baaf971eb8f None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:10.819428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5466-8ecf-44ef-8ded-1baaf971eb8f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:10.819428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5466-8ecf-44ef-8ded-1baaf971eb8f None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:10.820889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:10.827580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ee76-cb9a-40d5-ac3a-bad6ea46edc2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:10.828326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ee76-cb9a-40d5-ac3a-bad6ea46edc2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:10.828545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ee76-cb9a-40d5-ac3a-bad6ea46edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:10.850972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:10.912559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0781ee76-cb9a-40d5-ac3a-bad6ea46edc2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:10.913793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0781ee76-cb9a-40d5-ac3a-bad6ea46edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:11.016773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:11.179447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc5466-8ecf-44ef-8ded-1baaf971eb8f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:11.182314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-affc5466-8ecf-44ef-8ded-1baaf971eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:11.303795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:11.346658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc5466-8ecf-44ef-8ded-1baaf971eb8f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:11.466022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:11.466679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:11.466953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:11.467218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:11.469201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:11.560583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:11.575568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:11.577172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d281e-7cb8-4277-a565-8dda16c35f1b service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:11.596002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 713/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:12.455503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715191-3e10-473f-ba94-e86419559eeb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:12.456406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715191-3e10-473f-ba94-e86419559eeb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:12.456406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715191-3e10-473f-ba94-e86419559eeb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:12.458642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:12.464824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e90628-630d-4ce2-ae2c-cc7cf95d97fb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:12.465298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e90628-630d-4ce2-ae2c-cc7cf95d97fb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:12.465410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e90628-630d-4ce2-ae2c-cc7cf95d97fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:12.548326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-52e90628-630d-4ce2-ae2c-cc7cf95d97fb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:12.549623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-52e90628-630d-4ce2-ae2c-cc7cf95d97fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:12.665199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:12.825003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715191-3e10-473f-ba94-e86419559eeb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:12.826588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-24715191-3e10-473f-ba94-e86419559eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:12.929540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:12.992970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715191-3e10-473f-ba94-e86419559eeb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:13.108307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:13.108840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:13.109113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:13.109411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:13.111045 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:13.163642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:13.211682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:13.213311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187832e-666c-4095-be8c-a810b75baadf service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:13.233076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 714/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:14.042459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7091c8-f19d-4e50-9bc0-513121a3ddc7 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:14.043050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7091c8-f19d-4e50-9bc0-513121a3ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:14.043050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7091c8-f19d-4e50-9bc0-513121a3ddc7 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:14.044603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:14.051888 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fafb-bff7-41b3-ac5b-8d2f0b0b32b0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:14.052361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fafb-bff7-41b3-ac5b-8d2f0b0b32b0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:14.052479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fafb-bff7-41b3-ac5b-8d2f0b0b32b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:14.131365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cc29fafb-bff7-41b3-ac5b-8d2f0b0b32b0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:14.132571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cc29fafb-bff7-41b3-ac5b-8d2f0b0b32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:14.258578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:07:14.411916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7091c8-f19d-4e50-9bc0-513121a3ddc7 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:14.414282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4b7091c8-f19d-4e50-9bc0-513121a3ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:14.470118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:14.582931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7091c8-f19d-4e50-9bc0-513121a3ddc7 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:14.703671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:14.704494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:14.704767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:14.705043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:14.706716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:14.713800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:14.801575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:14.803183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03de3bd-ce78-466f-a09e-96f9af0b8a38 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:14.822710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 716/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:15.646570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195575a3-d140-4dc0-bcd4-d3a7d3fe2d6a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:15.647420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195575a3-d140-4dc0-bcd4-d3a7d3fe2d6a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:15.647420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195575a3-d140-4dc0-bcd4-d3a7d3fe2d6a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:15.649136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:15.657477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8c67-c703-4e3d-bdcd-d8430aff7eac None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:15.657949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8c67-c703-4e3d-bdcd-d8430aff7eac None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:15.658069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8c67-c703-4e3d-bdcd-d8430aff7eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:15.737794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-eacb8c67-c703-4e3d-bdcd-d8430aff7eac None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:15.738990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eacb8c67-c703-4e3d-bdcd-d8430aff7eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:15.811186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:15.842466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:15.998029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195575a3-d140-4dc0-bcd4-d3a7d3fe2d6a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:15.999463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-195575a3-d140-4dc0-bcd4-d3a7d3fe2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:16.018270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:16.152199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195575a3-d140-4dc0-bcd4-d3a7d3fe2d6a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:16.249611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:16.275657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:16.276273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:16.276542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:16.276859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:16.278573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:16.374024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:16.375622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b04fbe-8b8b-45e6-9a84-b74f3bd23496 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:16.394779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 717/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:17.207248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771dcd-864d-4c87-a24f-856dd311bdf6 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:17.208159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771dcd-864d-4c87-a24f-856dd311bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:17.208159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771dcd-864d-4c87-a24f-856dd311bdf6 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:17.210447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:17.218341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb30bc-33dc-44dc-9802-e9e8ebfa2ca0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:17.219128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb30bc-33dc-44dc-9802-e9e8ebfa2ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:17.219224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb30bc-33dc-44dc-9802-e9e8ebfa2ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:17.315418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dfdb30bc-33dc-44dc-9802-e9e8ebfa2ca0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:17.316658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dfdb30bc-33dc-44dc-9802-e9e8ebfa2ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:17.362632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:17.429897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:17.586007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb771dcd-864d-4c87-a24f-856dd311bdf6 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:17.588483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eb771dcd-864d-4c87-a24f-856dd311bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:17.750129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb771dcd-864d-4c87-a24f-856dd311bdf6 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:17.814191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:17.885116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:17.885893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:17.886241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:17.886481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:17.889447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:18.001632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:18.003242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30e877-78f6-44aa-88e7-0e93673fcf17 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:18.025262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 719/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:18.849882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03bde-672c-4fdf-9450-5b3e32d4f320 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:18.850798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03bde-672c-4fdf-9450-5b3e32d4f320 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:18.850798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03bde-672c-4fdf-9450-5b3e32d4f320 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:18.853003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:07:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:18.858340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05579fa-e56e-464a-ac4b-3584e484271c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:18.858779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05579fa-e56e-464a-ac4b-3584e484271c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:18.858942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05579fa-e56e-464a-ac4b-3584e484271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:18.950084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c05579fa-e56e-464a-ac4b-3584e484271c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:18.951292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c05579fa-e56e-464a-ac4b-3584e484271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:18.953507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:19.053874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:19.214636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e03bde-672c-4fdf-9450-5b3e32d4f320 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:19.216944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1e03bde-672c-4fdf-9450-5b3e32d4f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:19.392684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e03bde-672c-4fdf-9450-5b3e32d4f320 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:19.424986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:19.520078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:19.520733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:19.521012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:19.521311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:19.522967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:19.618973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:19.620735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd58b6-86a7-4c88-bd60-3ea0e7b6f8db service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:19.639674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 720/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:21.589559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ce41-5a0a-45c2-ab2c-0a939e1e032b None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:21.590122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ce41-5a0a-45c2-ab2c-0a939e1e032b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:21.590122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ce41-5a0a-45c2-ab2c-0a939e1e032b None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:21.591626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:21.598269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef0a48-5b62-4592-b416-9ab1c4fef488 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:21.598708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef0a48-5b62-4592-b416-9ab1c4fef488 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:21.598822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef0a48-5b62-4592-b416-9ab1c4fef488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:21.647293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:21.676143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8fef0a48-5b62-4592-b416-9ab1c4fef488 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:21.677373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8fef0a48-5b62-4592-b416-9ab1c4fef488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:21.782799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:21.827741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ce41-5a0a-45c2-ab2c-0a939e1e032b None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:21.829260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e969ce41-5a0a-45c2-ab2c-0a939e1e032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:21.953752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ce41-5a0a-45c2-ab2c-0a939e1e032b None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:21.993199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:22.042467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:22.043124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:22.043399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:22.043665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:22.045482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:22.178804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:22.180247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22746acf-2862-4a05-89f4-d9b06893d4b6 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:22.199196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 722/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:24.407842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30eca-6e16-44ce-b18d-4cede3d18e64 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:24.408872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30eca-6e16-44ce-b18d-4cede3d18e64 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:24.408872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30eca-6e16-44ce-b18d-4cede3d18e64 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:24.411058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:24.416680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf93f4-3473-4074-bcce-8084ae13b5d9 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:24.417193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf93f4-3473-4074-bcce-8084ae13b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:24.417332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf93f4-3473-4074-bcce-8084ae13b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:24.485415 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4cbf93f4-3473-4074-bcce-8084ae13b5d9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:24.487314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4cbf93f4-3473-4074-bcce-8084ae13b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:24.504659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:24.603496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:24.647083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30eca-6e16-44ce-b18d-4cede3d18e64 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:24.649754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-93b30eca-6e16-44ce-b18d-4cede3d18e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:24.765533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30eca-6e16-44ce-b18d-4cede3d18e64 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:24.780663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:24.854339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:24.854947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:24.855253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:24.855525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:24.857166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:24.988138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:24.989704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83117b8f-6e80-49f3-96c9-08a1fd860dd4 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:25.010637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 723/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:27.407940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb4fbf-e872-4d12-8d7f-59f2e7050eb6 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:27.408557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb4fbf-e872-4d12-8d7f-59f2e7050eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:27.408557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb4fbf-e872-4d12-8d7f-59f2e7050eb6 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:27.409949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:27.416411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5d4b-79d5-4030-a4c7-34a44f471853 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:27.417178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5d4b-79d5-4030-a4c7-34a44f471853 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:27.417396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5d4b-79d5-4030-a4c7-34a44f471853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:27.484712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:27.504613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-044c5d4b-79d5-4030-a4c7-34a44f471853 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:27.505866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-044c5d4b-79d5-4030-a4c7-34a44f471853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:27.611879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:27.653633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb4fbf-e872-4d12-8d7f-59f2e7050eb6 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:27.655222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-90cb4fbf-e872-4d12-8d7f-59f2e7050eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:27.766746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb4fbf-e872-4d12-8d7f-59f2e7050eb6 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:27.809808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:27.846915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:27.847567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:27.847843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:27.848114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:27.849791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:27.970605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:27.971967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf5b1a-16d8-40b2-b054-c7d65a25f351 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:27.991742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 725/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:30.174154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36916ba-9a22-4092-a489-f61519c73701 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:30.175012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36916ba-9a22-4092-a489-f61519c73701 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:30.175012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36916ba-9a22-4092-a489-f61519c73701 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:30.177152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:30.183598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a60f44-8b4d-4193-b0b6-a2698d49b108 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:30.184140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a60f44-8b4d-4193-b0b6-a2698d49b108 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:30.184140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a60f44-8b4d-4193-b0b6-a2698d49b108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:30.267604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-66a60f44-8b4d-4193-b0b6-a2698d49b108 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:30.268835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-66a60f44-8b4d-4193-b0b6-a2698d49b108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:30.291820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:30.376975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:30.421013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36916ba-9a22-4092-a489-f61519c73701 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:30.423520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d36916ba-9a22-4092-a489-f61519c73701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:30.538219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36916ba-9a22-4092-a489-f61519c73701 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:30.558896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:30.628331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:30.628991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:30.629272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:30.629557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:30.631235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:30.745217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:30.746867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69eea-facf-4e86-b096-ae521bd69e0e service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:30.767073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 726/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:32.926767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86b75-b1b9-4aa4-8d27-38f23e5b2575 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:32.927337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86b75-b1b9-4aa4-8d27-38f23e5b2575 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:32.927337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86b75-b1b9-4aa4-8d27-38f23e5b2575 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:32.928699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:32.935213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92763f-b264-4866-ae96-29c14585aeb9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:32.935643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92763f-b264-4866-ae96-29c14585aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:32.935752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92763f-b264-4866-ae96-29c14585aeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:33.001121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:33.004437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5c92763f-b264-4866-ae96-29c14585aeb9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:33.006463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5c92763f-b264-4866-ae96-29c14585aeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:33.120265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:33.161948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86b75-b1b9-4aa4-8d27-38f23e5b2575 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:33.164454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4ce86b75-b1b9-4aa4-8d27-38f23e5b2575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:33.277585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86b75-b1b9-4aa4-8d27-38f23e5b2575 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:33.332178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:33.359653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:33.360296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:33.360565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:33.360806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:33.362474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:33.487209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:33.488703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4af04-04f3-40da-9d57-df75e5f27ff3 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:33.508302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 728/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:35.708453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb4f8-c6a0-4734-8425-380ae5287d97 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:35.709475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb4f8-c6a0-4734-8425-380ae5287d97 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:35.709475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb4f8-c6a0-4734-8425-380ae5287d97 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:35.711622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:35.718221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179893d-6d80-457b-8a6e-43104e342446 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:35.719024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179893d-6d80-457b-8a6e-43104e342446 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:35.719137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179893d-6d80-457b-8a6e-43104e342446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:35.803150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8179893d-6d80-457b-8a6e-43104e342446 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:35.804395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8179893d-6d80-457b-8a6e-43104e342446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:35.837867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:35.933154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:35.975655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb4f8-c6a0-4734-8425-380ae5287d97 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:35.977219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6afeb4f8-c6a0-4734-8425-380ae5287d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:36.086784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb4f8-c6a0-4734-8425-380ae5287d97 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:36.116695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:36.167749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:36.168525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:36.168784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:36.169089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:36.170784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:36.289312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:36.291405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fc7ef-4cde-4f77-9ff8-b1e340e06d44 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:36.314969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 729/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:38.393295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e45f3-e5b6-4e74-bc27-c8e967a57d7a None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:38.394212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e45f3-e5b6-4e74-bc27-c8e967a57d7a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:38.394212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e45f3-e5b6-4e74-bc27-c8e967a57d7a None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:38.396561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:38.405752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e0e7-01f3-4561-a1c1-c5cec018d5aa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:38.406214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e0e7-01f3-4561-a1c1-c5cec018d5aa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:38.406454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e0e7-01f3-4561-a1c1-c5cec018d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:38.479391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5735e0e7-01f3-4561-a1c1-c5cec018d5aa None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:38.480611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5735e0e7-01f3-4561-a1c1-c5cec018d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:38.489377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:38.589070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:38.641038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e45f3-e5b6-4e74-bc27-c8e967a57d7a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:38.642621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ef2e45f3-e5b6-4e74-bc27-c8e967a57d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:38.749149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e45f3-e5b6-4e74-bc27-c8e967a57d7a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:38.812353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:38.831244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:38.831886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:38.832205 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:38.832505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:38.834188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:38.956905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:38.958861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb663-0223-449c-b02d-ef5d1c94f89d service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:38.981459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 731/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:41.077059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a0e9-69ed-4802-8ed2-f0c56b7c98e2 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:41.077997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a0e9-69ed-4802-8ed2-f0c56b7c98e2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:41.077997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a0e9-69ed-4802-8ed2-f0c56b7c98e2 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:41.080293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:41.089616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e74af-f68a-4335-8253-cd190cfc908d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:41.090405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e74af-f68a-4335-8253-cd190cfc908d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:41.090579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e74af-f68a-4335-8253-cd190cfc908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:41.169366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-617e74af-f68a-4335-8253-cd190cfc908d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:41.170591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-617e74af-f68a-4335-8253-cd190cfc908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:41.212920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:41.279202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:41.317127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a0e9-69ed-4802-8ed2-f0c56b7c98e2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:41.318753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7e79a0e9-69ed-4802-8ed2-f0c56b7c98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:41.445280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a0e9-69ed-4802-8ed2-f0c56b7c98e2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:41.484759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:41.521637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:41.522305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:41.522584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:41.522853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:41.524532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:41.650217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:41.651668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c9b34-3d58-4f20-b976-7e5f5bf3a373 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:41.671712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 732/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:43.754304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430bd4-a209-43a9-9471-d1c27d5b1f81 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:43.755201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430bd4-a209-43a9-9471-d1c27d5b1f81 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:43.755201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430bd4-a209-43a9-9471-d1c27d5b1f81 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:43.757496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:43.763119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a048-8e5d-4ca1-b26e-7d690e2309c7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:43.763649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a048-8e5d-4ca1-b26e-7d690e2309c7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:43.763649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a048-8e5d-4ca1-b26e-7d690e2309c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:43.845079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4384a048-8e5d-4ca1-b26e-7d690e2309c7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:43.846352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4384a048-8e5d-4ca1-b26e-7d690e2309c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:43.866631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:43.950790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:43.988884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf430bd4-a209-43a9-9471-d1c27d5b1f81 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:43.990465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bf430bd4-a209-43a9-9471-d1c27d5b1f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:44.104405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf430bd4-a209-43a9-9471-d1c27d5b1f81 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:44.194522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:44.205747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:44.206342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:44.206693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:44.207145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:44.209119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:44.339031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:44.340480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d487a-39b6-40b6-9532-9e13bb2dd999 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:44.361204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 734/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:46.453964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d329b-ab45-43b4-939e-906323b9ddfa None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:46.454577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d329b-ab45-43b4-939e-906323b9ddfa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:46.454577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d329b-ab45-43b4-939e-906323b9ddfa None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:46.455935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:07:46.461569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3465-00c8-4045-80a3-0869aaf5dfa7 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:46.462016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3465-00c8-4045-80a3-0869aaf5dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:46.462137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3465-00c8-4045-80a3-0869aaf5dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:46.536587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-acfb3465-00c8-4045-80a3-0869aaf5dfa7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:07:46.538131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-acfb3465-00c8-4045-80a3-0869aaf5dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:46.590088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:46.638733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:07:46.676367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d329b-ab45-43b4-939e-906323b9ddfa None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:07:46.678079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1c8d329b-ab45-43b4-939e-906323b9ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:46.793351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d329b-ab45-43b4-939e-906323b9ddfa None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:07:46.852708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:46.886344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:07:46.886992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:07:46.887272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:07:46.887543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:07:46.889374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:07:47.008447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:07:47.009954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764c69d-5335-4d6e-b788-178970bff9cb service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:07:47.029161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 735/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:07:56.636775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=22 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:57.026748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=66 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:07.126670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f80d1-7ec4-4aac-addd-f13363e1db42 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:07.127657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f80d1-7ec4-4aac-addd-f13363e1db42 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:07.127657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f80d1-7ec4-4aac-addd-f13363e1db42 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:07.129907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 736/1471] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:07.139241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443a60-5e5d-4052-90b4-63ec7a9b6065 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:07.139707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443a60-5e5d-4052-90b4-63ec7a9b6065 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:07.139927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443a60-5e5d-4052-90b4-63ec7a9b6065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:07.220311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8c443a60-5e5d-4052-90b4-63ec7a9b6065 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:07.221572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8c443a60-5e5d-4052-90b4-63ec7a9b6065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:07.334694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 736/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:07.435838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181572-f2ea-486a-b0bd-2851af1388a6 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:07.436086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181572-f2ea-486a-b0bd-2851af1388a6 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:07.436382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181572-f2ea-486a-b0bd-2851af1388a6 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:07.437800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 737/1473] 10.222.0.67 () {54 vars in 966 bytes} [Wed Jul 20 09:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:07.442714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad3a7-fc69-46f5-afb6-affcb94a81b3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:07.442999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad3a7-fc69-46f5-afb6-affcb94a81b3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:07.443267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad3a7-fc69-46f5-afb6-affcb94a81b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:07.523746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c33ad3a7-fc69-46f5-afb6-affcb94a81b3 None None] MFA Rules not processed for user `f2d3b8154d784b779c87717947789ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:07.525643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c33ad3a7-fc69-46f5-afb6-affcb94a81b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:07.554801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:07.615082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 737/1474] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Jul 20 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:08:07.622768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181572-f2ea-486a-b0bd-2851af1388a6 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:07.624275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-52181572-f2ea-486a-b0bd-2851af1388a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:07.734283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181572-f2ea-486a-b0bd-2851af1388a6 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:07.816412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:07.817078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:07.817339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:07.817639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:07.819308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:07.883001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:07.942942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:07.944435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfe79c-1928-4b03-89b6-18ab3c156e9d service glance] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:07.963828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 738/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:08:10.101485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351884a9-3ec4-440b-9e8a-c7c93ae11c97 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:10.102419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351884a9-3ec4-440b-9e8a-c7c93ae11c97 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:10.102419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351884a9-3ec4-440b-9e8a-c7c93ae11c97 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:10.104626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 738/1476] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:10.110314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa668-1c92-46ff-9b0f-ff25810a16a9 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:10.110769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa668-1c92-46ff-9b0f-ff25810a16a9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:10.110875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa668-1c92-46ff-9b0f-ff25810a16a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:10.191978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-be5fa668-1c92-46ff-9b0f-ff25810a16a9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:10.193201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-be5fa668-1c92-46ff-9b0f-ff25810a16a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:10.305629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 739/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:10.329852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351884a9-3ec4-440b-9e8a-c7c93ae11c97 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:10.331460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-351884a9-3ec4-440b-9e8a-c7c93ae11c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:10.477193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351884a9-3ec4-440b-9e8a-c7c93ae11c97 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:10.529532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:10.583417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:10.584086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:10.584358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:10.584623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:10.585387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:10.587263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:08:10.587263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:08:10.587263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:08:10.588417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935e459-1f25-4ba6-ace7-a0b72799b084 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:10.609253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 739/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 20 09:08:10 2022] GET /identity/v3/projects => generated 2553 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:08:12.675944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977bbf3-28fc-4530-94a5-13a1438a7559 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:12.676811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977bbf3-28fc-4530-94a5-13a1438a7559 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:12.676811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977bbf3-28fc-4530-94a5-13a1438a7559 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:12.678632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 740/1479] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:12.684339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c432436-d157-4f7e-aeb9-cb4af96d27c1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:12.684854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c432436-d157-4f7e-aeb9-cb4af96d27c1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:12.684854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c432436-d157-4f7e-aeb9-cb4af96d27c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:12.764127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0c432436-d157-4f7e-aeb9-cb4af96d27c1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:12.765493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c432436-d157-4f7e-aeb9-cb4af96d27c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:12.873965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 740/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:12.921167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977bbf3-28fc-4530-94a5-13a1438a7559 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:12.922739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0977bbf3-28fc-4530-94a5-13a1438a7559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:12.932919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:13.086471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977bbf3-28fc-4530-94a5-13a1438a7559 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:13.180095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:13.219514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:13.220169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:13.220449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:13.220716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:13.222407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:13.324387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:13.326079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f8650-dec6-4683-8e34-bd5a711d6164 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:13.346851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 741/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:08:15.652151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e1e5c-9860-4a78-b87e-6af13b481038 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:15.652725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e1e5c-9860-4a78-b87e-6af13b481038 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:15.652725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e1e5c-9860-4a78-b87e-6af13b481038 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:15.654973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 741/1482] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:15.661538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f301c-5df1-4687-926a-8393b4aa6a12 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:15.661982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f301c-5df1-4687-926a-8393b4aa6a12 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:15.662150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f301c-5df1-4687-926a-8393b4aa6a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:15.736396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-364f301c-5df1-4687-926a-8393b4aa6a12 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:15.737657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-364f301c-5df1-4687-926a-8393b4aa6a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:15.785676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:15.841035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 742/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:15.880679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e1e5c-9860-4a78-b87e-6af13b481038 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:15.882726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c22e1e5c-9860-4a78-b87e-6af13b481038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:15.913105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:16.029892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e1e5c-9860-4a78-b87e-6af13b481038 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:16.114097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:16.114740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:16.115015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:16.115287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:16.116948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:16.192900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:16.237788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:16.239242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779bb23-f596-48bc-aa76-9ef89d9d9c14 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:16.266933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 742/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:08:18.375426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1230f6-1076-4244-8178-87e2838e60f1 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:18.376326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1230f6-1076-4244-8178-87e2838e60f1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:18.376326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1230f6-1076-4244-8178-87e2838e60f1 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:18.378572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 743/1485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:18.385041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b96d7e-f134-4c1e-84dd-475f89ce9fdb None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:18.385980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b96d7e-f134-4c1e-84dd-475f89ce9fdb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:18.385980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b96d7e-f134-4c1e-84dd-475f89ce9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:18.459007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-95b96d7e-f134-4c1e-84dd-475f89ce9fdb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:18.460245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-95b96d7e-f134-4c1e-84dd-475f89ce9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:18.568178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 743/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:18.619470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1230f6-1076-4244-8178-87e2838e60f1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:18.621042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ae1230f6-1076-4244-8178-87e2838e60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:18.744571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1230f6-1076-4244-8178-87e2838e60f1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:18.821340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:18.823247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:18.823920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:18.824448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:18.824912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:18.826980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:18.944268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:18.945751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fc9de-2878-4348-86bc-f7531e0ec594 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:18.964986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 744/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:08:21.177977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef7280-9502-42ca-8cd8-9f71305f2ad3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:21.178625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef7280-9502-42ca-8cd8-9f71305f2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:21.178625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef7280-9502-42ca-8cd8-9f71305f2ad3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:21.180290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 744/1488] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:21.186866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ecaad-ad9b-458c-a9bc-4628df18958c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:21.187646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ecaad-ad9b-458c-a9bc-4628df18958c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:21.187803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ecaad-ad9b-458c-a9bc-4628df18958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:21.273821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d13ecaad-ad9b-458c-a9bc-4628df18958c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:21.275060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d13ecaad-ad9b-458c-a9bc-4628df18958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:21.334323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:21.383704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 745/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:21.434545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef7280-9502-42ca-8cd8-9f71305f2ad3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:21.436119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cfef7280-9502-42ca-8cd8-9f71305f2ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:21.481762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:21.570028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef7280-9502-42ca-8cd8-9f71305f2ad3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:21.653902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:21.654625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:21.655050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:21.655365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:21.657022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:21.744917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:21.777138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:21.778745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16201a52-67da-4672-b9a7-13e34e1ce167 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:21.798116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 745/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:08:24.095539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832828-b69a-4090-b143-bc67de92a617 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:24.096143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832828-b69a-4090-b143-bc67de92a617 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:24.096143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832828-b69a-4090-b143-bc67de92a617 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:24.097585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 746/1491] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 20 09:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:08:24.103779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65a52-2d82-4123-a0c6-503da23e8fe6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:24.104235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65a52-2d82-4123-a0c6-503da23e8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:24.104342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65a52-2d82-4123-a0c6-503da23e8fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:24.181104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-69c65a52-2d82-4123-a0c6-503da23e8fe6 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:08:24.182412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-69c65a52-2d82-4123-a0c6-503da23e8fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:24.285159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 746/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 20 09:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:08:24.324463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832828-b69a-4090-b143-bc67de92a617 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:08:24.326058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6d832828-b69a-4090-b143-bc67de92a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:24.444732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832828-b69a-4090-b143-bc67de92a617 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:08:24.527695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:08:24.528336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:08:24.528613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:08:24.528882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:08:24.530639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:08:24.540107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:24.648024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:08:24.649494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe4ec7-bb93-4b7f-9915-008ffbec1907 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:08:24.667991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 747/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:08:34.283234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=82 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:08:34.665619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=50 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:52.372291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:52.373107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:52.373107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:52.453126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:09:52.454369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:52.559769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 747/1494] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:09:52.568356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:52.568884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:52.568884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:52.644347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:09:52.645574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:52.755005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 748/1495] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:09:52.762198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:52.763436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:52.775933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a0e0c-a5fd-49eb-9cac-378fbf98f82d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:52.848772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:52.892841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:52.893572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:52.893847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:52.894118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:52.894845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:09:52.895146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:52.896182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:52.896182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:09:52.896182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:09:52.897068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:52.909459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 748/1496] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:09:52.922730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:52.937068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da2d8-7af9-4b02-b1c4-723ea6965faf None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:53.003831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:53.039771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:53.040436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:53.040721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:53.040986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:53.041707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:53.043457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:53.043457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:09:53.043457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:09:53.044647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:53.102807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 749/1497] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:09:52 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:09:53.107146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:53.108718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:53.143884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e2bf6-bf07-4a56-8580-f5c248790933 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:53.246227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:53.247211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:53.247572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:53.247972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:53.248948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:53.250537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:53.250537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:09:53.250537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:09:53.252409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:53.301887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 749/1498] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:09:53 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:09:53.306749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:53.308300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:53.374596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4a905-ce63-40b1-9c35-dad1f8f1d1b6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:53.462173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:53.474211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:53.474897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:53.475178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:53.475456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:53.476188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:53.477406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:53.477406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:09:53.477406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:09:53.478493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:53.491068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 750/1499] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:09:53.495685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:53.497248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:53.509128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8bad0-e70b-49f1-9128-f9ebf965d90f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:53.536362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:53.610655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:53.611509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:53.611786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:53.612109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:53.613214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:53.614861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:53.614861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:09:53.614861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:09:53.616142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90a948-38da-48e0-ab45-ffc937d82feb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:53.632397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 750/1500] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:09:53.637437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:53.639593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:53.680115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193f81f-7102-46a0-9192-ead24b9b58f0 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:53.794772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:53.796521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:53.796804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:53.797082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] PATH_INFO: `/v3/projects/7621e7e6a33e4678814778463ee59faa/users/3ac794bf9f8744a5869f89c2de0ada85/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:53.831219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7621e7e6a33e4678814778463ee59faa, user_id=3ac794bf9f8744a5869f89c2de0ada85, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:53.832275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:53.832275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:09:53.832275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:09:53.834271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42399a98-e0f8-4e5f-ba8e-dbbd7cbea55d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:53.866979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 751/1501] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:09:53 2022] PUT /identity/v3/projects/7621e7e6a33e4678814778463ee59faa/users/3ac794bf9f8744a5869f89c2de0ada85/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:09:53.880399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3ac6f-467a-4969-8821-f5412ea8c1d7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:53.880685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3ac6f-467a-4969-8821-f5412ea8c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:53.880961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3ac6f-467a-4969-8821-f5412ea8c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:53.941354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-74b3ac6f-467a-4969-8821-f5412ea8c1d7 None None] MFA Rules not processed for user `3ac794bf9f8744a5869f89c2de0ada85`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:09:53.942512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-74b3ac6f-467a-4969-8821-f5412ea8c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:54.028808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 751/1502] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:09:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:09:54.043021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961964c5-91ef-42e4-9242-597d808d494a None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:54.043334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961964c5-91ef-42e4-9242-597d808d494a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:54.043596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961964c5-91ef-42e4-9242-597d808d494a None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:54.044991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 752/1503] 10.222.0.67 () {54 vars in 964 bytes} [Wed Jul 20 09:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:09:54.050520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519bfa-b17d-49e0-b546-215c43fbcd86 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:54.050805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519bfa-b17d-49e0-b546-215c43fbcd86 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:54.051101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519bfa-b17d-49e0-b546-215c43fbcd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:54.083566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:54.139979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-82519bfa-b17d-49e0-b546-215c43fbcd86 None None] MFA Rules not processed for user `264ac709e4744acdaf774ab52c165862`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:09:54.141223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-82519bfa-b17d-49e0-b546-215c43fbcd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:54.232359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 752/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Jul 20 09:09:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:09:54.240401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961964c5-91ef-42e4-9242-597d808d494a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:54.241951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-961964c5-91ef-42e4-9242-597d808d494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:54.300037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:54.361315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961964c5-91ef-42e4-9242-597d808d494a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:54.441736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:54.442387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:54.442667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:54.442938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:54.444589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:54.563090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:54.564540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:54.568113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:54.584819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 753/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:09:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:09:54.628726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffeb4e-61d1-42d3-a113-27932ed7a95d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:54.629175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffeb4e-61d1-42d3-a113-27932ed7a95d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:54.629306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffeb4e-61d1-42d3-a113-27932ed7a95d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:54.630610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 753/1506] 10.222.0.67 () {52 vars in 829 bytes} [Wed Jul 20 09:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:09:54.634305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:54.635547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:54.740679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901daa28-233d-4530-a48f-f75e4078f302 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:54.844321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:54.845148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:54.845450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:54.845714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] PATH_INFO: `/v3/users/3ac794bf9f8744a5869f89c2de0ada85` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:54.858967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac794bf9f8744a5869f89c2de0ada85)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:54.860030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:54.860030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:09:54.860030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:09:54.861262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:54.871309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:54.935601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac794bf9f8744a5869f89c2de0ada85'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:54.961680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac794bf9f8744a5869f89c2de0ada85'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:54.962368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac794bf9f8744a5869f89c2de0ada85'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:54.962899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac794bf9f8744a5869f89c2de0ada85'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:54.980762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac794bf9f8744a5869f89c2de0ada85'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:55.000822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 754/1507] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:09:54 2022] DELETE /identity/v3/users/3ac794bf9f8744a5869f89c2de0ada85 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:09:55.007862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:55.008227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:55.008637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:55.071166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:09:55.072424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:55.155732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:55.169801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 754/1508] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:09:55.179956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:55.181256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:55.291928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd9829-a018-4340-b813-4dac6e5c6809 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:55.350451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:09:55.379495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:55.380170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:55.380443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:55.380715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:55.382418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:55.499505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:55.500893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d719e4-37c3-4e39-ad09-96a6e974ed12 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:55.521254 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 755/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:09:55.901328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:09:55.902570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:09:55.914564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5b283-866e-4926-9041-235c0862f980 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:09:56.021150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:09:56.022002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:09:56.022278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:09:56.022548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] PATH_INFO: `/v3/projects/7621e7e6a33e4678814778463ee59faa` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:09:56.033400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7621e7e6a33e4678814778463ee59faa)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:09:56.034447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:09:56.034447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:09:56.034447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:09:56.035640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:09:56.100012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7621e7e6a33e4678814778463ee59faa', 'request_id': 'req-0d854e00-142c-4b75-852d-eae982ddea74'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:56.107381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7621e7e6a33e4678814778463ee59faa', 'request_id': 'req-0d854e00-142c-4b75-852d-eae982ddea74'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:56.120942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7621e7e6a33e4678814778463ee59faa', 'request_id': 'req-0d854e00-142c-4b75-852d-eae982ddea74'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:56.150334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] The token cache is being invalidate because project 7621e7e6a33e4678814778463ee59faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:09:56.150617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:56.151141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0d854e00-142c-4b75-852d-eae982ddea74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:09:56.152586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 755/1510] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:09:55 2022] DELETE /identity/v3/projects/7621e7e6a33e4678814778463ee59faa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:10:05.518615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=62 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:10:06.148057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:11:45.969337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6f6d-6ff9-4fd4-a432-5dbb2edc2738 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:45.969988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6f6d-6ff9-4fd4-a432-5dbb2edc2738 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:45.969988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6f6d-6ff9-4fd4-a432-5dbb2edc2738 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:45.971365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:11:45.977741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f16bd-edae-4dc9-bf29-f9136879923b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:45.978502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f16bd-edae-4dc9-bf29-f9136879923b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:45.978636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f16bd-edae-4dc9-bf29-f9136879923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:46.077390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-668f16bd-edae-4dc9-bf29-f9136879923b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:11:46.078710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-668f16bd-edae-4dc9-bf29-f9136879923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:11:46.192389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:11:46.348004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b6f6d-6ff9-4fd4-a432-5dbb2edc2738 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:11:46.350665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e61b6f6d-6ff9-4fd4-a432-5dbb2edc2738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:11:46.496947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b6f6d-6ff9-4fd4-a432-5dbb2edc2738 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:11:46.504676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2e293-2c40-4715-bfae-7b5266677ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:11:46.505364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e293-2c40-4715-bfae-7b5266677ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:46.505651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e293-2c40-4715-bfae-7b5266677ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:46.505924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e293-2c40-4715-bfae-7b5266677ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:46.515244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2e293-2c40-4715-bfae-7b5266677ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:11:46.516988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2e293-2c40-4715-bfae-7b5266677ce0 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:11:46.526842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 757/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:11:47.321984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca967-785e-4598-9d3f-33bd12cd6231 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:47.322566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca967-785e-4598-9d3f-33bd12cd6231 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:47.322566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca967-785e-4598-9d3f-33bd12cd6231 None None] PATH_INFO: `/v3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:47.323933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 757/1514] 10.222.0.83 () {54 vars in 925 bytes} [Wed Jul 20 09:11:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:11:47.331039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6817f4-e2dc-433d-9cd4-bf801ed7f707 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:47.331555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6817f4-e2dc-433d-9cd4-bf801ed7f707 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:47.331555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6817f4-e2dc-433d-9cd4-bf801ed7f707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:47.371598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c9e0-d7f5-47e3-9ff1-69e72a71e958 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:47.371874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c9e0-d7f5-47e3-9ff1-69e72a71e958 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:47.372161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c9e0-d7f5-47e3-9ff1-69e72a71e958 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:47.373629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 758/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:11:47.378871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:47.379146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:47.379422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:47.393506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9b6817f4-e2dc-433d-9cd4-bf801ed7f707 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:11:47.394743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9b6817f4-e2dc-433d-9cd4-bf801ed7f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:11:47.398877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:11:47.400059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:11:47.409420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 759/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:11:47.472686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:11:47.479216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 758/1517] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Jul 20 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:11:47.566449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:11:47.579103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924840-a935-4b38-813e-390abbe00ec0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:11:47.584501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ae926-6623-4f02-a6a2-ef164d214b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:11:47.585149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae926-6623-4f02-a6a2-ef164d214b46 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:47.585455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae926-6623-4f02-a6a2-ef164d214b46 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:47.585724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae926-6623-4f02-a6a2-ef164d214b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:47.595430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae926-6623-4f02-a6a2-ef164d214b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:11:47.597035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae926-6623-4f02-a6a2-ef164d214b46 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:11:47.608398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 760/1518] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:11:56.525491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ee840-be68-4743-96cf-a1c44da590a0 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:56.526066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ee840-be68-4743-96cf-a1c44da590a0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:56.526066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ee840-be68-4743-96cf-a1c44da590a0 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:56.527330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 759/1519] 10.222.0.67 () {54 vars in 961 bytes} [Wed Jul 20 09:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:11:56.533606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8ca25-866f-48d4-8cd5-e332bba58578 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:56.534344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8ca25-866f-48d4-8cd5-e332bba58578 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:56.534495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8ca25-866f-48d4-8cd5-e332bba58578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:56.562618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a2b8ca25-866f-48d4-8cd5-e332bba58578 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:11:56.563839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a2b8ca25-866f-48d4-8cd5-e332bba58578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:11:56.574473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 761/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Jul 20 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:11:56.582739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ee840-be68-4743-96cf-a1c44da590a0 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:11:56.606188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ee840-be68-4743-96cf-a1c44da590a0 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:11:56.613361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e03f7-9a83-4807-8b59-8330bbba9750 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:11:56.613999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e03f7-9a83-4807-8b59-8330bbba9750 service placement] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:56.614276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e03f7-9a83-4807-8b59-8330bbba9750 service placement] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:56.614641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e03f7-9a83-4807-8b59-8330bbba9750 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:56.624255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e03f7-9a83-4807-8b59-8330bbba9750 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:11:56.625898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e03f7-9a83-4807-8b59-8330bbba9750 service placement] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:11:56.637636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 760/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:11:58.884098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9f5f-3c88-4e5e-9878-15b654d297c7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:58.884708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9f5f-3c88-4e5e-9878-15b654d297c7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:58.884708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9f5f-3c88-4e5e-9878-15b654d297c7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:58.886835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:11:58.892037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c4f6-408d-44cd-9e90-c2d09809be17 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:58.892483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c4f6-408d-44cd-9e90-c2d09809be17 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:58.892583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c4f6-408d-44cd-9e90-c2d09809be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:58.912375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-94c4c4f6-408d-44cd-9e90-c2d09809be17 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:11:58.913628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-94c4c4f6-408d-44cd-9e90-c2d09809be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:11:58.922443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:11:59.086648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9f5f-3c88-4e5e-9878-15b654d297c7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:11:59.107679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9f5f-3c88-4e5e-9878-15b654d297c7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:11:59.113558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57445c8-f908-48f6-ab96-70fce54764fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:11:59.114197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57445c8-f908-48f6-ab96-70fce54764fa service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:59.114475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57445c8-f908-48f6-ab96-70fce54764fa service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:59.114746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57445c8-f908-48f6-ab96-70fce54764fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:59.123167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57445c8-f908-48f6-ab96-70fce54764fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:11:59.124739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57445c8-f908-48f6-ab96-70fce54764fa service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:11:59.134666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 763/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:11:59.956547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85be09-5b8a-4013-924f-d89aea9df69a None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:59.957106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85be09-5b8a-4013-924f-d89aea9df69a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:59.957106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85be09-5b8a-4013-924f-d89aea9df69a None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:59.959398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:11:59.968291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb212-2477-463d-8d68-fc35b518a7f2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:11:59.969095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb212-2477-463d-8d68-fc35b518a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:11:59.969095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb212-2477-463d-8d68-fc35b518a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:11:59.991449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a26bb212-2477-463d-8d68-fc35b518a7f2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:11:59.992693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a26bb212-2477-463d-8d68-fc35b518a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:00.001967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:12:00.157392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85be09-5b8a-4013-924f-d89aea9df69a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:12:00.180768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85be09-5b8a-4013-924f-d89aea9df69a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:12:00.187398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538602-c440-45af-a10b-9ef88492cbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:12:00.188044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538602-c440-45af-a10b-9ef88492cbd4 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:00.188328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538602-c440-45af-a10b-9ef88492cbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:00.188599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538602-c440-45af-a10b-9ef88492cbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:00.197616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538602-c440-45af-a10b-9ef88492cbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:12:00.199215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538602-c440-45af-a10b-9ef88492cbd4 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:12:00.214737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 763/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:12:04.302503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef6a6-e28e-48a7-9fe3-2a6ac918f89b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:04.303396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef6a6-e28e-48a7-9fe3-2a6ac918f89b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:04.303396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef6a6-e28e-48a7-9fe3-2a6ac918f89b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:04.305019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:12:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:12:04.312094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f9917-bd70-4132-9b91-d28745515cf4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:04.312719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f9917-bd70-4132-9b91-d28745515cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:04.312719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f9917-bd70-4132-9b91-d28745515cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:04.334574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e25f9917-bd70-4132-9b91-d28745515cf4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:12:04.335810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e25f9917-bd70-4132-9b91-d28745515cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:04.345354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:12:04.426830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef6a6-e28e-48a7-9fe3-2a6ac918f89b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:12:04.430429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-197ef6a6-e28e-48a7-9fe3-2a6ac918f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:04.464555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:04.524235 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef6a6-e28e-48a7-9fe3-2a6ac918f89b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:12:04.528572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaeaf8-bcc2-4050-a330-e6305a9c47df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:12:04.529259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaeaf8-bcc2-4050-a330-e6305a9c47df service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:04.529553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaeaf8-bcc2-4050-a330-e6305a9c47df service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:04.529824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaeaf8-bcc2-4050-a330-e6305a9c47df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:04.539892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaeaf8-bcc2-4050-a330-e6305a9c47df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:12:04.541372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaeaf8-bcc2-4050-a330-e6305a9c47df service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:12:04.551001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 766/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:12:06.611074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74f1a-1eac-49e0-963f-55579de89d75 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:06.611684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74f1a-1eac-49e0-963f-55579de89d75 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:06.611684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74f1a-1eac-49e0-963f-55579de89d75 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:06.613005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:12:06.618838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a46e-ebd1-450a-94b0-0f74bd9523e0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:06.619372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a46e-ebd1-450a-94b0-0f74bd9523e0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:06.619480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a46e-ebd1-450a-94b0-0f74bd9523e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:06.645896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f8d4a46e-ebd1-450a-94b0-0f74bd9523e0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:12:06.647168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f8d4a46e-ebd1-450a-94b0-0f74bd9523e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:06.657720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:12:06.707459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74f1a-1eac-49e0-963f-55579de89d75 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:12:06.724422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74f1a-1eac-49e0-963f-55579de89d75 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:12:06.729646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5101-e42f-4bcc-8e3b-2c7222cc9be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:12:06.730380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5101-e42f-4bcc-8e3b-2c7222cc9be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:06.730655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5101-e42f-4bcc-8e3b-2c7222cc9be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:06.732730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5101-e42f-4bcc-8e3b-2c7222cc9be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:06.748270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5101-e42f-4bcc-8e3b-2c7222cc9be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:12:06.751193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5101-e42f-4bcc-8e3b-2c7222cc9be9 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:12:06.765416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 766/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:12:10.344093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5719b-a5eb-4015-a6f2-c77530f5a216 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:10.344673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5719b-a5eb-4015-a6f2-c77530f5a216 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:10.344673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5719b-a5eb-4015-a6f2-c77530f5a216 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:10.346057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:12:10.352761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad197ceb-1add-4f96-9423-8277730916c3 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:10.353575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad197ceb-1add-4f96-9423-8277730916c3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:10.353758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad197ceb-1add-4f96-9423-8277730916c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:10.382603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ad197ceb-1add-4f96-9423-8277730916c3 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:12:10.383843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ad197ceb-1add-4f96-9423-8277730916c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:10.391958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:12:10.704683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5719b-a5eb-4015-a6f2-c77530f5a216 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:12:10.707974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-06a5719b-a5eb-4015-a6f2-c77530f5a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:10.793587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5719b-a5eb-4015-a6f2-c77530f5a216 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:12:10.797650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815d28d-764a-4511-be0a-37b8cdeb4502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:12:10.798304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d28d-764a-4511-be0a-37b8cdeb4502 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:10.798576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d28d-764a-4511-be0a-37b8cdeb4502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:10.798847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d28d-764a-4511-be0a-37b8cdeb4502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:10.808448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815d28d-764a-4511-be0a-37b8cdeb4502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:12:10.809990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815d28d-764a-4511-be0a-37b8cdeb4502 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:12:10.820273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 769/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:12:12.889779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea434-e8b0-4aca-8af7-f1ae27216962 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:12.890375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea434-e8b0-4aca-8af7-f1ae27216962 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:12.890375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea434-e8b0-4aca-8af7-f1ae27216962 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:12.891667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:12:12.899133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9022-8fc3-4c6a-80db-97041d6dd234 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:12.899623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9022-8fc3-4c6a-80db-97041d6dd234 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:12.899623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9022-8fc3-4c6a-80db-97041d6dd234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:12.923591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-519c9022-8fc3-4c6a-80db-97041d6dd234 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:12:12.925360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-519c9022-8fc3-4c6a-80db-97041d6dd234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:12.934543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:12:13.237837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ea434-e8b0-4aca-8af7-f1ae27216962 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:12:13.239983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e85ea434-e8b0-4aca-8af7-f1ae27216962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:12:13.254955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ea434-e8b0-4aca-8af7-f1ae27216962 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:12:13.259080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ec1a2-0bd8-4843-99dd-58aeab49e03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:12:13.259727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec1a2-0bd8-4843-99dd-58aeab49e03e service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:12:13.260015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec1a2-0bd8-4843-99dd-58aeab49e03e service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:12:13.260264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec1a2-0bd8-4843-99dd-58aeab49e03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:12:13.269941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ec1a2-0bd8-4843-99dd-58aeab49e03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:12:13.271492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ec1a2-0bd8-4843-99dd-58aeab49e03e service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:12:13.281158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 769/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:12:22.915385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=66 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:23.277139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=34 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:45.423166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.423800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.423800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.448000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.449636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.465694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 771/1540] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.475273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.475856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.475856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.510816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.512196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.524401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 770/1541] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.528990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:45.544167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9230ed9-f71e-498f-b5b9-10dce8ba2666 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:45.549347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:45.550028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.550306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.550576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.551312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:45.551613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:45.553251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93586-930d-486b-9f00-ced418123a95 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:45.572840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 772/1542] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:45.581790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:45.590016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04b9fb-094a-4975-8437-829433341b6f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.590384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04b9fb-094a-4975-8437-829433341b6f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.590562 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04b9fb-094a-4975-8437-829433341b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.595662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d45a7-b09d-4db5-a2e9-9349d5d40634 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:45.606314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:45.607025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.607310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.607587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.608294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:45.610342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:45.615131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0e04b9fb-094a-4975-8437-829433341b6f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.616361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0e04b9fb-094a-4975-8437-829433341b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.630312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 773/1543] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.639273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.639631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.640322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.664681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.674771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.683559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 774/1544] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:13:45.686074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 771/1545] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:45.688599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:45.699127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfefd2-5c5a-4695-8976-6dd5689b017f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:45.702346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:45.801798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:45.802485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.802768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.803164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.804185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:45.804498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:45.806154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a32348-0c81-4d39-b517-dca1ff6bbef6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:45.821575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 775/1546] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:45.822919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73bd36-e10e-439d-8b9d-de27efece07e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.823202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73bd36-e10e-439d-8b9d-de27efece07e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.823535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73bd36-e10e-439d-8b9d-de27efece07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.846868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda53eb-734c-436a-b9fa-3a2247131e0b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:45.852565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:45.853264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.853556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.853832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.854856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:45.856976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:13:45.856976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:13:45.856976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:13:45.858395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511b454-7cda-42b7-8b14-d7b9b9d689b5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:45.861719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ed73bd36-e10e-439d-8b9d-de27efece07e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.862931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ed73bd36-e10e-439d-8b9d-de27efece07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.873745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 776/1547] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.875193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be5ff-73a4-4020-9549-830cb567234f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.875474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be5ff-73a4-4020-9549-830cb567234f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.875745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be5ff-73a4-4020-9549-830cb567234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.893423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 772/1548] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:13:45.895297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.895594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.895868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.903814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2d9be5ff-73a4-4020-9549-830cb567234f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.905112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2d9be5ff-73a4-4020-9549-830cb567234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.914436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 777/1549] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.915782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efada-e455-4148-93ab-73ffe45daa2e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.916064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efada-e455-4148-93ab-73ffe45daa2e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.916337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efada-e455-4148-93ab-73ffe45daa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.919392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.920655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.932186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 773/1550] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.933579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:45.937178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-394efada-e455-4148-93ab-73ffe45daa2e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.938445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-394efada-e455-4148-93ab-73ffe45daa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.950703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8be8d-afa5-4f4c-bfcc-901faeca91ec None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:45.953987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 778/1551] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.955473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.955760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.956037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.963519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50429-33ef-4401-8573-df2accb1a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:45.964623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50429-33ef-4401-8573-df2accb1a669 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:45.964909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50429-33ef-4401-8573-df2accb1a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:45.969261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50429-33ef-4401-8573-df2accb1a669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:45.969261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50429-33ef-4401-8573-df2accb1a669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:45.969261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50429-33ef-4401-8573-df2accb1a669 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:45.977988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:45.979241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:45.991799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 779/1552] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:45.991799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:45.999899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55248a-62ce-4ade-b88d-221ee2d8a338 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.002283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 774/1553] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:45 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.003843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7de8c-4c45-42f7-8195-a73589453fd4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.004139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7de8c-4c45-42f7-8195-a73589453fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.004408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7de8c-4c45-42f7-8195-a73589453fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.007190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5d265-3b73-46c3-827a-d27a6c49dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.007890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5d265-3b73-46c3-827a-d27a6c49dbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.008165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5d265-3b73-46c3-827a-d27a6c49dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.008431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5d265-3b73-46c3-827a-d27a6c49dbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.009165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5d265-3b73-46c3-827a-d27a6c49dbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.011197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5d265-3b73-46c3-827a-d27a6c49dbf3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.025007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 780/1554] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:46.025253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d2f7de8c-4c45-42f7-8195-a73589453fd4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.025412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf64b-f536-497f-a99d-fb9032cce617 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.025522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d2f7de8c-4c45-42f7-8195-a73589453fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.025631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf64b-f536-497f-a99d-fb9032cce617 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.025631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf64b-f536-497f-a99d-fb9032cce617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.042856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2f5cf64b-f536-497f-a99d-fb9032cce617 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.044071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2f5cf64b-f536-497f-a99d-fb9032cce617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.084617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 775/1555] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.085945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.086228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.086501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.106420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.106646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 781/1556] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.107631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.111850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf7451-4e83-4ca8-af21-714c77eb4bf8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.112135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf7451-4e83-4ca8-af21-714c77eb4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.112409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf7451-4e83-4ca8-af21-714c77eb4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.119137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 776/1557] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.119137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.125987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e524bd-0c6c-4cd4-a57b-7fffaa52a165 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.130967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.131617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.131895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.132167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.132888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:46.133191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.134133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0cbf7451-4e83-4ca8-af21-714c77eb4bf8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.134250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:13:46.134250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:13:46.134250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:13:46.135086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.135447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0cbf7451-4e83-4ca8-af21-714c77eb4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.144520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 782/1558] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.145810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.146098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.146374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.147541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 777/1559] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:46.148326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.154676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.159184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2935-9345-495f-aeb0-280c0018cd98 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.164911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.165624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.166079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.166766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.167281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.169322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.172505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.173748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.183125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 783/1560] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.184380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.194106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 778/1561] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.194106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.197100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf69e-63e5-42d5-a532-7f677d0e4424 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.201783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87144-da56-4f17-bf0c-85bbfbd6e63a admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.201995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.202679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.203070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.203340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.204081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.205758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.206384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.207067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.207346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.207615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.208352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:46.208632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.210287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.211573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.217670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 784/1562] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:46.218909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.227092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 779/1563] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:46.227797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.229019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a018-c357-4073-8247-65297c3104cf admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.233802 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.234523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.234800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.235067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.235782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:46.236080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.237720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca788f-0fd0-47f0-8da7-fcd3dfe2c0a6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.237830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432269-e71e-4bd7-b85e-a9fff75040a5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.242398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.243037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.243314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.243588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.244306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:46.244615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.246409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.250301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 785/1564] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:46.251500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9514-dfb2-413a-b32d-e225130799ac None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.251782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9514-dfb2-413a-b32d-e225130799ac None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.252052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9514-dfb2-413a-b32d-e225130799ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.270107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 780/1565] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:46.270107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.270408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-864d9514-dfb2-413a-b32d-e225130799ac None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.271697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-864d9514-dfb2-413a-b32d-e225130799ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.275424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dc5de-d78d-4fdf-a587-e0ec9a706f75 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.280003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 786/1566] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.280395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.281174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.281477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.281588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.281886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.281991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.282285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.282771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.284737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.301744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.302946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.311313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 787/1567] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.313323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.323496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 781/1568] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.323496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.323864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc991a81-7aa9-4e81-87be-bc0bc5a78def None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.380485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.381159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.381466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.381733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.382461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.384062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.385246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e85035-67ab-4954-bbcf-a4716230bcff admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.390431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.391328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.391607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.391879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] PATH_INFO: `/v3/projects/979c722a06cc41cd923085150e9f1e6b/users/48409a02ebce4520bdd728d7dfa985bc/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.394708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 788/1569] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:46.395512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.405254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c95a63-85a9-4777-94ac-875c1a9c54d1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.409854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.410516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.410793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.411056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979c722a06cc41cd923085150e9f1e6b, user_id=48409a02ebce4520bdd728d7dfa985bc, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.411182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.411742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.412758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:13:46.412758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:13:46.412758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:13:46.413783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.413969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.427973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 782/1570] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:46 2022] PUT /identity/v3/projects/979c722a06cc41cd923085150e9f1e6b/users/48409a02ebce4520bdd728d7dfa985bc/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:46.428980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.445714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 789/1571] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.445714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.500067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad8ab-24ef-417a-a26a-d7e60b22db65 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.504844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.505779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.505875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.506079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.506194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf771-0fe8-477f-9725-74d9879b9072 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.506803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.508761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.511180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.511977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.512370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.512638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.513364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.515247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.537817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 783/1572] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.542213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.546299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 790/1573] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.546299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.553946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.580242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.609284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca999276-4eb0-4f82-88c4-6932cc29569f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.611086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a6386-1b2c-4b16-98a6-e23b1827513d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.614015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.614719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.614970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.615258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.616008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:46.616139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.616322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.616781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.617041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.617333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.617947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.618051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:46.618343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.619923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.630312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 791/1574] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:46.631467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.631632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 784/1575] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:46.632323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.642671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad9c5-38bf-48e0-85e3-e314b57c57ec admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.647533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898abd6-6d7c-4e64-ac4b-55aa7b9beca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.648193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898abd6-6d7c-4e64-ac4b-55aa7b9beca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.648465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898abd6-6d7c-4e64-ac4b-55aa7b9beca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.648705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898abd6-6d7c-4e64-ac4b-55aa7b9beca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.649118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89490d-47b2-4a11-be24-052e99a2c2e2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.649489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898abd6-6d7c-4e64-ac4b-55aa7b9beca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.651067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898abd6-6d7c-4e64-ac4b-55aa7b9beca8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.654462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.655124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.655400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.655670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.656360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.658305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.661708 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 785/1576] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:46.663004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.663293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.663566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.685338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 792/1577] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.685338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.692799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] MFA Rules not processed for user `48409a02ebce4520bdd728d7dfa985bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:46.693387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9095-8201-4141-be9f-b3ff22fe6d81 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.694027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:46.700813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.701627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.701914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.702186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.702880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.704851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.726704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 793/1578] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.727575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.738554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef8cc1-5770-421f-a671-002fde70d148 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.743443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.744236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.744571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.744906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.746053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.748132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.759390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 786/1579] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:46.760223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.770498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 794/1580] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.771675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.771834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678a3c-261c-4a4b-95ad-9666d4db8da1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.776630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.777580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.777853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.778121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.779425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.781377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.782991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84dd2b-87fc-46d3-8a10-8a587bf04362 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.788622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.789407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.789875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.790003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.790681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.793729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.806848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 787/1581] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.810470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.823884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e0f4-a764-483c-9473-23ce2d560c9a admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.827838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 795/1582] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.828623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.829405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.829744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.830075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.830835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.831980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.833121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.861572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 788/1583] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:46 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:46.862418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.898699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f55d9-2798-4161-9dcf-67ee41997a03 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.913937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.935497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4f56-14a3-4dca-85aa-80b0eb1dd423 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.940179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.940865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.941143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.941472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.942220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.943816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.954267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 789/1584] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:46.955204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.959024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.959951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.960226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.960492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] PATH_INFO: `/v3/projects/a205848753ba47158b59ebee3fffa81d/users/dcf8635a22eb4c829a7a99ce4f9fb379/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.962993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.966294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a7b0b-4f6a-4a80-8fb2-e55a48dea115 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:46.971320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:46.971959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:46.972285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:46.972593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:46.973454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.975100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.981718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a205848753ba47158b59ebee3fffa81d, user_id=dcf8635a22eb4c829a7a99ce4f9fb379, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:46.982865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:13:46.982865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:13:46.982865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:13:46.984768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aa22d-3354-41a1-b511-440eed1b07a8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:46.985624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 790/1585] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:46.986421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:46.996660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61c7e5-9336-4ac0-8909-2c8856c17045 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.001994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 796/1586] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:46 2022] PUT /identity/v3/projects/a205848753ba47158b59ebee3fffa81d/users/dcf8635a22eb4c829a7a99ce4f9fb379/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:47.003517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcddbf-f8f6-4250-b697-00c13ffdbbc1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.003879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcddbf-f8f6-4250-b697-00c13ffdbbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.004227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcddbf-f8f6-4250-b697-00c13ffdbbc1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.005923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 797/1587] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 20 09:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:13:47.006727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcddbf-f8f6-4250-b697-00c13ffdbbc1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.054435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.055122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.055407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.055677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.056406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.058175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.068099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 791/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.071453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.078404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab45928-6feb-4e1d-a221-628ecc548bca admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.078601 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcddbf-f8f6-4250-b697-00c13ffdbbc1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.083159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.083809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.083921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.084084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.084352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.084528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.084806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.085032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.085129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.085819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.086974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.087411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.099220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 798/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.100419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.110846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602be45-df67-40aa-adbb-4078d435dbca admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.115353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 792/1590] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:47.115353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.119275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e46b59-4a30-4c24-ba0a-31f789271fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.120003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e46b59-4a30-4c24-ba0a-31f789271fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.120376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e46b59-4a30-4c24-ba0a-31f789271fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.120653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e46b59-4a30-4c24-ba0a-31f789271fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.121517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e46b59-4a30-4c24-ba0a-31f789271fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.122698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8852e-817f-4271-89b3-328f352b4f58 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.123578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e46b59-4a30-4c24-ba0a-31f789271fc9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.127127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.127785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.128059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.128327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.129034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.130627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.141831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 793/1591] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.142675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.145958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 799/1592] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:47.147253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.147542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.147815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.154699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db8b4-53d8-477c-ad93-e18190f5d43d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.159091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd92d-f728-49ea-9087-bf985855d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.159748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd92d-f728-49ea-9087-bf985855d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.160023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd92d-f728-49ea-9087-bf985855d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.160294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd92d-f728-49ea-9087-bf985855d6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.161388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd92d-f728-49ea-9087-bf985855d6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.162973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd92d-f728-49ea-9087-bf985855d6ed admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.165858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:47.167062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:47.173785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 794/1593] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.175106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.175382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.175632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.178346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 800/1594] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:47.179172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.193704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcadbc-711d-4850-9d1b-130778a4619a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.198884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.199553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.199828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.200100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.200827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.202469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.212591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 801/1595] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.213344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.220211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:47.221966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:47.224286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae3abc-07da-49ec-9441-98b63b7690b3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.228921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.229718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.229997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.230276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.230987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.232629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.242511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 802/1596] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.243294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.252793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0157f-b598-4a0a-948a-e6b95f8094cc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.257343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.257982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.258261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.258533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.259245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.260857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.272172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 803/1597] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.272768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.277725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:47.283415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecce73-35bf-4a0e-86c6-2032d49b0500 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.288561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.289370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 795/1598] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:47.289599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.289704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.289981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] PATH_INFO: `/v3/projects/3983674ece774d72ba495a54862e43f8/users/d0db4cc91baa4721b5c6d750eeddf9bf/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.290435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.301143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917181-b023-4e2e-abd1-f76957c9dd56 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.306527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.307410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.307785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3983674ece774d72ba495a54862e43f8, user_id=d0db4cc91baa4721b5c6d750eeddf9bf, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.308075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.308356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.309341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.310646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.311514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.324509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 796/1599] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.325393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.326663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 804/1600] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:47 2022] PUT /identity/v3/projects/3983674ece774d72ba495a54862e43f8/users/d0db4cc91baa4721b5c6d750eeddf9bf/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:47.327689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.336189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e723-2ead-47f1-b654-d003e3eb617d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.386401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc047-0719-41c3-a1c4-b8f58da57d58 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.390677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.391338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.391611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.391876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.393144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.394073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.394354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.394623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] PATH_INFO: `/v3/projects/dbe19f6f4fde417497eddf8ec34438a2/users/d5ec6bd7834c4bcb804fadd742162484/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.401424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.403509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.408532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:47.409840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe19f6f4fde417497eddf8ec34438a2, user_id=d5ec6bd7834c4bcb804fadd742162484, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.412531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.414237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 805/1601] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:47.414920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.426535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644df1-8036-4419-9346-49d58b4289d0 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.429980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 797/1602] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:47 2022] PUT /identity/v3/projects/dbe19f6f4fde417497eddf8ec34438a2/users/d5ec6bd7834c4bcb804fadd742162484/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:47.431167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.522290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.523867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.524385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.524876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] PATH_INFO: `/v3/projects/36cd0cfd4df346bb8aed79b8abe7deba/users/df82c6072a514e57bee56d7951ea2b46/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.539738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032add9-6983-4278-b3c2-39ea6060a5fc admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.547108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.548573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.549058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.549608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] PATH_INFO: `/v3/projects/43af1c2368134967b0f321700b55fb0e/users/375a65c49fe843538ff349221800cf30/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.551962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cd0cfd4df346bb8aed79b8abe7deba, user_id=df82c6072a514e57bee56d7951ea2b46, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.556619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.574209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43af1c2368134967b0f321700b55fb0e, user_id=375a65c49fe843538ff349221800cf30, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.577461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.578041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 806/1603] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:47 2022] PUT /identity/v3/projects/36cd0cfd4df346bb8aed79b8abe7deba/users/df82c6072a514e57bee56d7951ea2b46/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:47.579420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.602297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 798/1604] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:47 2022] PUT /identity/v3/projects/43af1c2368134967b0f321700b55fb0e/users/375a65c49fe843538ff349221800cf30/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:47.604000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.671248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:47.676728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc2025-f1f5-41b5-877c-7e27c40e24d5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.699884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d3430-47ee-48e9-b29b-a2574fe6ed40 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.707543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda3e6c-cdab-43f7-a1ec-1d29a1bf193b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.708360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda3e6c-cdab-43f7-a1ec-1d29a1bf193b service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.708738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda3e6c-cdab-43f7-a1ec-1d29a1bf193b service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.709153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda3e6c-cdab-43f7-a1ec-1d29a1bf193b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.751861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.753100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.753783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.754289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.755419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.757400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.779022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 807/1605] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.781474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.788337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda3e6c-cdab-43f7-a1ec-1d29a1bf193b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.790759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39867c9-0d4a-4a89-88dc-69f0e34746ab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:47.791085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda3e6c-cdab-43f7-a1ec-1d29a1bf193b service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.799137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2feb0-103d-41e8-812f-8dec9fbd9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:47.800069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2feb0-103d-41e8-812f-8dec9fbd9414 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.801555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2feb0-103d-41e8-812f-8dec9fbd9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.801906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2feb0-103d-41e8-812f-8dec9fbd9414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.803038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2feb0-103d-41e8-812f-8dec9fbd9414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:47.804966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 799/1606] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:47.805109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2feb0-103d-41e8-812f-8dec9fbd9414 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:47.806787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22328a70-b1b7-4d12-84c0-895ba944d805 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.807435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22328a70-b1b7-4d12-84c0-895ba944d805 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.808065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22328a70-b1b7-4d12-84c0-895ba944d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.816882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 808/1607] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:47.818059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6737-6c02-465a-a290-7bbb160790d3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.818428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6737-6c02-465a-a290-7bbb160790d3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.818846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6737-6c02-465a-a290-7bbb160790d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.831443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-22328a70-b1b7-4d12-84c0-895ba944d805 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:47.833312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-22328a70-b1b7-4d12-84c0-895ba944d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:47.844314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 800/1608] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:47.846002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.846470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.846912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.857997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-271f6737-6c02-465a-a290-7bbb160790d3 None None] MFA Rules not processed for user `d5ec6bd7834c4bcb804fadd742162484`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:47.859706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-271f6737-6c02-465a-a290-7bbb160790d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:47.864458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:47.881061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] MFA Rules not processed for user `df82c6072a514e57bee56d7951ea2b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:47.882911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:47.939089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 809/1609] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:47.940899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:47.941220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:47.942831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:47.963521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:47.965650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:47.974783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 810/1610] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:47.985309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:47.996127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989f257-2ab4-43af-a0fb-38042f23ad6a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.001759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.002907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.003298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.004089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] PATH_INFO: `/v3/projects/52e80f2ab84b45ae85d495f32feb67a1/users/ccb80ebfa0dd459bb55861b621bc1815/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.012394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 801/1611] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:48.013338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.026967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e80f2ab84b45ae85d495f32feb67a1, user_id=ccb80ebfa0dd459bb55861b621bc1815, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.027791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20884-0127-4b69-a0bd-a5d6b7bbdac9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.031576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.040778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.042287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.046006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.046006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] PATH_INFO: `/v3/projects/c0dda13a2a4f4bf48c194df9167b7cb3/users/5ed9d1c1ec4f419898831b7557b93693/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.061605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 811/1612] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:47 2022] PUT /identity/v3/projects/52e80f2ab84b45ae85d495f32feb67a1/users/ccb80ebfa0dd459bb55861b621bc1815/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:48.062859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.072661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dda13a2a4f4bf48c194df9167b7cb3, user_id=5ed9d1c1ec4f419898831b7557b93693, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.076611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.103588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 802/1613] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:48 2022] PUT /identity/v3/projects/c0dda13a2a4f4bf48c194df9167b7cb3/users/5ed9d1c1ec4f419898831b7557b93693/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:48.104685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.189411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b468e-569b-45f3-aa30-2f39041db2d0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.224640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:48.248881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff402405-7a81-491d-896e-d07d87e4a54f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.254650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.255447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.255786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.256554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.256947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.258999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.325046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 803/1614] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:48.334257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.351228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.352109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.352629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.353012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.368956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.370829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.384930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 812/1615] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:48.386317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.399574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387399d5-cdca-4332-b4a6-1f9714da1a24 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.439236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:48.477260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992650cb-e332-48c0-81a8-7e6b2098faa8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.478937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f668e-5d11-4e4d-a3bb-6255a3067446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.480131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f668e-5d11-4e4d-a3bb-6255a3067446 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.480629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f668e-5d11-4e4d-a3bb-6255a3067446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.481434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f668e-5d11-4e4d-a3bb-6255a3067446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.481944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5398-82c9-4717-9985-949a3ec5dab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.482676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5398-82c9-4717-9985-949a3ec5dab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.482985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f668e-5d11-4e4d-a3bb-6255a3067446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.483128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5398-82c9-4717-9985-949a3ec5dab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.483288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5398-82c9-4717-9985-949a3ec5dab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.485950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f668e-5d11-4e4d-a3bb-6255a3067446 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.495704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5398-82c9-4717-9985-949a3ec5dab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.497683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5398-82c9-4717-9985-949a3ec5dab0 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.509526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 804/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:48.512367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329cd1-6c49-4e65-9226-3c4eb52dbf7b None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.512716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329cd1-6c49-4e65-9226-3c4eb52dbf7b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.513249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329cd1-6c49-4e65-9226-3c4eb52dbf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.533807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 813/1617] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/projects => generated 405 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:48.535543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.535904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.536287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.548496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-31329cd1-6c49-4e65-9226-3c4eb52dbf7b None None] MFA Rules not processed for user `ccb80ebfa0dd459bb55861b621bc1815`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:48.549854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-31329cd1-6c49-4e65-9226-3c4eb52dbf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:48.563949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:48.565527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:48.633969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 805/1618] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:48.633969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d43ba-9efa-4faf-8c89-dffaf4c75472 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.633969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d43ba-9efa-4faf-8c89-dffaf4c75472 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.633969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d43ba-9efa-4faf-8c89-dffaf4c75472 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.633969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 806/1619] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 20 09:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:13:48.634917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d43ba-9efa-4faf-8c89-dffaf4c75472 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.659721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 814/1620] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:48.667741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.696608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ebcf0-abdb-4e32-983c-f0e21002b69c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.706449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9e2bd-cf2e-4377-b37e-ca4337e701b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.708839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9e2bd-cf2e-4377-b37e-ca4337e701b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.708839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9e2bd-cf2e-4377-b37e-ca4337e701b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.708839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9e2bd-cf2e-4377-b37e-ca4337e701b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.709456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9e2bd-cf2e-4377-b37e-ca4337e701b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.716916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9e2bd-cf2e-4377-b37e-ca4337e701b3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.727987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d43ba-9efa-4faf-8c89-dffaf4c75472 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.737647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9cb05-f7ac-44be-ba16-0df4b4501425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.738708 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9cb05-f7ac-44be-ba16-0df4b4501425 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.739196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9cb05-f7ac-44be-ba16-0df4b4501425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.739774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9cb05-f7ac-44be-ba16-0df4b4501425 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.740673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9cb05-f7ac-44be-ba16-0df4b4501425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.743669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9cb05-f7ac-44be-ba16-0df4b4501425 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.748998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 815/1621] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:48.750667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.750959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.751282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.776334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:48.781926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:48.783530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:48.788240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 807/1622] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:48.790183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892253d3-b89b-4975-b19d-bd74653d2fa8 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.790490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892253d3-b89b-4975-b19d-bd74653d2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.790764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892253d3-b89b-4975-b19d-bd74653d2fa8 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.797111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 808/1623] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 20 09:13:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:13:48.798322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892253d3-b89b-4975-b19d-bd74653d2fa8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.801813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-892253d3-b89b-4975-b19d-bd74653d2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:48.917785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892253d3-b89b-4975-b19d-bd74653d2fa8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.923236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.923795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.924859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.925570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.928834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 816/1624] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:48.930384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.940168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.942528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.951666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68be9b-b007-4a22-b2d7-4ff8382fefcd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.956755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 809/1625] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:48.957757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:48.973000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1bd3f-cc99-47b6-8469-52300ecf0661 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:48.975925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.976635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.976915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.977186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.980214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75ad8-9a22-43b4-9f41-edceadcdd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:48.981131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75ad8-9a22-43b4-9f41-edceadcdd880 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:48.981581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75ad8-9a22-43b4-9f41-edceadcdd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:48.982396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75ad8-9a22-43b4-9f41-edceadcdd880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:48.982519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.983380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75ad8-9a22-43b4-9f41-edceadcdd880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:48.985737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75ad8-9a22-43b4-9f41-edceadcdd880 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:48.986300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.005353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 810/1626] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:49.005353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.005353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.005353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.016190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 817/1627] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:49.016507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.035549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:49.037344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:49.052460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 811/1628] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 20 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:49.053887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.069580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ca482-db50-4628-a2e9-679d11d09903 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.078150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.079986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.080630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.081099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] PATH_INFO: `/v3/projects/9fb0a84adf394bf095d46f17522633fa/users/a0b68bdb0f59428787462f1e162a0a19/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.109249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:49.113948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb0a84adf394bf095d46f17522633fa, user_id=a0b68bdb0f59428787462f1e162a0a19, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.120980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.148094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 812/1629] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:49 2022] PUT /identity/v3/projects/9fb0a84adf394bf095d46f17522633fa/users/a0b68bdb0f59428787462f1e162a0a19/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:49.148094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.158397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f70dc-0880-4b5d-b7e7-643746ce83dd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.248669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7903a-beea-4698-b7f3-8cc88dc1f5fa admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.256882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.257943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.258855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.259170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] PATH_INFO: `/v3/projects/4596e83dcd3b47118c3500da1df3a176/users/9d73b9a0885b4855a23277821e39baa7/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.298789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4596e83dcd3b47118c3500da1df3a176, user_id=9d73b9a0885b4855a23277821e39baa7, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.302758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.307023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.311586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.312359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.315644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.339840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 813/1630] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:49 2022] PUT /identity/v3/projects/4596e83dcd3b47118c3500da1df3a176/users/9d73b9a0885b4855a23277821e39baa7/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:49.341021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.464370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:49.509166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.510897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.516829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044368b1-03cf-4cc8-92da-3ae95804c30a admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.538189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 818/1631] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:49.540709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.545770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.546441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.546820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.547096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.568607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab7d41-99f0-46ab-9dee-9d17133007a0 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.701110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.704335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.726022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.727469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.727858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.727981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 814/1632] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:49.728198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.730334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.732508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.734792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.751449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 819/1633] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:49.753095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.757144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916655-1c19-4970-968e-ad2261a53c1b service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.769909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.770323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53dd2c-1e54-4517-a3df-ba01192cf152 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.770938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.771218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.771541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.772406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.776299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.778859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff526c-5fcb-47c6-a19e-46b6a5be7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.779756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff526c-5fcb-47c6-a19e-46b6a5be7712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.780086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff526c-5fcb-47c6-a19e-46b6a5be7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.780569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff526c-5fcb-47c6-a19e-46b6a5be7712 admin admin] PATH_INFO: `/v3/projects/9fb0a84adf394bf095d46f17522633fa/users/a0b68bdb0f59428787462f1e162a0a19/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.783956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff526c-5fcb-47c6-a19e-46b6a5be7712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb0a84adf394bf095d46f17522633fa, user_id=a0b68bdb0f59428787462f1e162a0a19, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.788987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff526c-5fcb-47c6-a19e-46b6a5be7712 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:49.803942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 815/1634] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:49.805480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:49.815848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 820/1635] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:49 2022] PUT /identity/v3/projects/9fb0a84adf394bf095d46f17522633fa/users/a0b68bdb0f59428787462f1e162a0a19/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:49.819458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.819807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.823293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.838270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52566b0c-dd24-4ed0-9596-00ca9d98361f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:49.842016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:49.894689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] MFA Rules not processed for user `a0b68bdb0f59428787462f1e162a0a19`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:49.896007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:49.978986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e8ed6-3645-449b-8c73-be2d418aa9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:49.980047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e8ed6-3645-449b-8c73-be2d418aa9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:49.980388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e8ed6-3645-449b-8c73-be2d418aa9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:49.981038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e8ed6-3645-449b-8c73-be2d418aa9f1 admin admin] PATH_INFO: `/v3/projects/4596e83dcd3b47118c3500da1df3a176/users/9d73b9a0885b4855a23277821e39baa7/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:49.984006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e8ed6-3645-449b-8c73-be2d418aa9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4596e83dcd3b47118c3500da1df3a176, user_id=9d73b9a0885b4855a23277821e39baa7, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:49.987842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e8ed6-3645-449b-8c73-be2d418aa9f1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:50.011797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 816/1636] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:49 2022] PUT /identity/v3/projects/4596e83dcd3b47118c3500da1df3a176/users/9d73b9a0885b4855a23277821e39baa7/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:13:50.014517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe753-8002-4b9e-aafd-bc9683e36889 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:50.014874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe753-8002-4b9e-aafd-bc9683e36889 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:50.015218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe753-8002-4b9e-aafd-bc9683e36889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:50.066477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 821/1637] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:50.075363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:50.085098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-128fe753-8002-4b9e-aafd-bc9683e36889 None None] MFA Rules not processed for user `9d73b9a0885b4855a23277821e39baa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:50.086463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-128fe753-8002-4b9e-aafd-bc9683e36889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:50.208098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1575b64-15de-46d2-a98f-067128e34f06 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:50.230811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:50.270432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 817/1638] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:50.340120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4517891-b539-4bc4-be62-2a49c642ac48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:50.341066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517891-b539-4bc4-be62-2a49c642ac48 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:50.341477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517891-b539-4bc4-be62-2a49c642ac48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:50.341884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517891-b539-4bc4-be62-2a49c642ac48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:50.420242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:50.427835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4517891-b539-4bc4-be62-2a49c642ac48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:50.429508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4517891-b539-4bc4-be62-2a49c642ac48 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:50.443629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 822/1639] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:13:50.474485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8c41e-50bc-4ee5-beb0-d37cbede6027 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:50.474864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8c41e-50bc-4ee5-beb0-d37cbede6027 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:50.475086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8c41e-50bc-4ee5-beb0-d37cbede6027 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:50.476797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 818/1640] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 20 09:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:13:50.483153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:50.483447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:50.483768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:50.507949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:50.509700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:50.564002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8c41e-50bc-4ee5-beb0-d37cbede6027 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:50.593140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8c41e-50bc-4ee5-beb0-d37cbede6027 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:50.612559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:50.613308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:50.613596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:50.613873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:50.657695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:50.660379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:50.689195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 819/1641] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:13:50.737379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 823/1642] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:50.879047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:50.891542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dc371-b8b5-465e-9e85-30b04fdbf320 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:50.897313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:50.898083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:50.898361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:50.898627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:50.911106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:50.912574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:50.928696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 820/1643] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:51.240439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:51.256446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd094-0289-4f20-a14f-66033ee2a52b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:51.266794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a77f-2a00-4991-98bb-58fb2df095fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:51.269339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a77f-2a00-4991-98bb-58fb2df095fb service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:51.269906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a77f-2a00-4991-98bb-58fb2df095fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:51.270825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a77f-2a00-4991-98bb-58fb2df095fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:51.420521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247a77f-2a00-4991-98bb-58fb2df095fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:51.422031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247a77f-2a00-4991-98bb-58fb2df095fb service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:51.474033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 824/1644] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:51.880997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:52.044112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1e992-d4b8-4d34-8594-faf0d66b767e service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:52.052512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:52.053624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:52.053986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:52.054381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] PATH_INFO: `/v3/users/df82c6072a514e57bee56d7951ea2b46` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:52.060001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df82c6072a514e57bee56d7951ea2b46)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:52.062803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:52.150272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df82c6072a514e57bee56d7951ea2b46'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:52.173579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df82c6072a514e57bee56d7951ea2b46'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:52.174668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df82c6072a514e57bee56d7951ea2b46'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:52.175483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df82c6072a514e57bee56d7951ea2b46'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:52.191903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df82c6072a514e57bee56d7951ea2b46'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:52.219043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 821/1645] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:13:51 2022] DELETE /identity/v3/users/df82c6072a514e57bee56d7951ea2b46 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:52.220627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:52.221107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:52.221368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:52.259329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:52.263443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:52.393583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 825/1646] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:13:52.545536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:52.547312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:52.621075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:52.645494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40603d-8a00-465c-9da2-859c95a53fc5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:52.651765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:52.653379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:52.653908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:52.654413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:52.672267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:52.675396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:52.707085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 822/1647] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:13:54.364682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:54.366394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:54.395029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19dbce-3cfd-47c2-bea9-db593ace106d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:54.409395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:54.411574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:54.412981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:54.413380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] PATH_INFO: `/v3/users/ccb80ebfa0dd459bb55861b621bc1815` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:54.418541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb80ebfa0dd459bb55861b621bc1815)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:54.421768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:13:54.421768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: warnings.warn(msg) Jul 20 09:13:54.421768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: Jul 20 09:13:54.426124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:54.538074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:54.539790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:54.550961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:54.565288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1e7a-f163-4b64-b88d-85313d1e5b26 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:54.583860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:54.584902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:54.585333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:54.585704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] PATH_INFO: `/v3/projects/36cd0cfd4df346bb8aed79b8abe7deba` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:54.588322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cd0cfd4df346bb8aed79b8abe7deba)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:54.590176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: WARNING py.warnings [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:13:54.590176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: warnings.warn(msg) Jul 20 09:13:54.590176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: Jul 20 09:13:54.595168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:54.648040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb80ebfa0dd459bb55861b621bc1815'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.719158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb80ebfa0dd459bb55861b621bc1815'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.722002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb80ebfa0dd459bb55861b621bc1815'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.723366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb80ebfa0dd459bb55861b621bc1815'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.795825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cd0cfd4df346bb8aed79b8abe7deba', 'request_id': 'req-47b7d359-4639-4125-80ae-2969e9428005'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.797942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c91f4fe-052b-4251-8331-56ef617658eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb80ebfa0dd459bb55861b621bc1815'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.815814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cd0cfd4df346bb8aed79b8abe7deba', 'request_id': 'req-47b7d359-4639-4125-80ae-2969e9428005'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.849948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 826/1648] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:13:54 2022] DELETE /identity/v3/users/ccb80ebfa0dd459bb55861b621bc1815 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:54.851613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:54.851969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:54.852419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:54.869208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cd0cfd4df346bb8aed79b8abe7deba', 'request_id': 'req-47b7d359-4639-4125-80ae-2969e9428005'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.910575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:54.912090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:54.929497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] The token cache is being invalidate because project 36cd0cfd4df346bb8aed79b8abe7deba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:13:54.930550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.933654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:54.942753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 823/1649] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:13:54 2022] DELETE /identity/v3/projects/36cd0cfd4df346bb8aed79b8abe7deba => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:54.946755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:54.952653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:55.079232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 827/1650] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:55.164659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:55.166186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:55.220114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7d359-4639-4125-80ae-2969e9428005 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:55.240402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:55.241385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:55.241669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:55.241941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] PATH_INFO: `/v3/users/9d73b9a0885b4855a23277821e39baa7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:55.243656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d73b9a0885b4855a23277821e39baa7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:55.245750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:55.347371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311b03-4420-4b5b-856e-11feaaf0d53a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:55.359939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:55.361101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:55.361482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:55.361810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:55.376965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:55.380879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:55.399337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 828/1651] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:13:55.414966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d73b9a0885b4855a23277821e39baa7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:55.448299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d73b9a0885b4855a23277821e39baa7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:55.451346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d73b9a0885b4855a23277821e39baa7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:55.452782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d73b9a0885b4855a23277821e39baa7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:55.481896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:55.514153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d73b9a0885b4855a23277821e39baa7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:55.559456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 824/1652] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:13:54 2022] DELETE /identity/v3/users/9d73b9a0885b4855a23277821e39baa7 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:57.163469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:57.165700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:57.193005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67397901-05db-4787-ac31-de9bdc1116d0 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:57.264460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:57.267326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:57.290919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:57.345867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:57.346833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.347323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.348048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] PATH_INFO: `/v3/users/48409a02ebce4520bdd728d7dfa985bc` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.351287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48409a02ebce4520bdd728d7dfa985bc)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:57.354189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:57.394859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7330-37b0-4073-ae78-47e0d6e56e17 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:57.401453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:57.402902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.403626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.404074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] PATH_INFO: `/v3/projects/52e80f2ab84b45ae85d495f32feb67a1` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.406695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e80f2ab84b45ae85d495f32feb67a1)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:57.408828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:57.470215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48409a02ebce4520bdd728d7dfa985bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.485208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e80f2ab84b45ae85d495f32feb67a1', 'request_id': 'req-a193a69e-f1ea-4ca8-8977-872568fd614a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.493697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e80f2ab84b45ae85d495f32feb67a1', 'request_id': 'req-a193a69e-f1ea-4ca8-8977-872568fd614a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.503252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e80f2ab84b45ae85d495f32feb67a1', 'request_id': 'req-a193a69e-f1ea-4ca8-8977-872568fd614a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.504560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48409a02ebce4520bdd728d7dfa985bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.505729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48409a02ebce4520bdd728d7dfa985bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.507342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48409a02ebce4520bdd728d7dfa985bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.522464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ef897884-624d-4e8b-b63b-9aabbae23060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48409a02ebce4520bdd728d7dfa985bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.526823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] The token cache is being invalidate because project 52e80f2ab84b45ae85d495f32feb67a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:13:57.527221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.528125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a193a69e-f1ea-4ca8-8977-872568fd614a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:57.534746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 825/1653] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:13:57 2022] DELETE /identity/v3/projects/52e80f2ab84b45ae85d495f32feb67a1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:13:57.540977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58108b96-2d02-4789-aee2-b53c3983918e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.541360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58108b96-2d02-4789-aee2-b53c3983918e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.541939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58108b96-2d02-4789-aee2-b53c3983918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.553461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 829/1654] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:13:57 2022] DELETE /identity/v3/users/48409a02ebce4520bdd728d7dfa985bc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:57.558113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.558635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.559104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.570279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-58108b96-2d02-4789-aee2-b53c3983918e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:57.571748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-58108b96-2d02-4789-aee2-b53c3983918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:57.606476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:57.608071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:57.738285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 826/1655] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:57.746031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.746303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.746577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.766723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 830/1656] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:13:57.780936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:57.782457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:57.796838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:57.804090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 827/1657] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:13:57.808685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fcd2-157b-4cc8-83d0-86d9323c7141 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:57.815765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:57.816798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.817178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.817596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.818471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:57.818886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:57.821027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:57.839110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 831/1658] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:13:57.841930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:57.855158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80409606-59a2-4823-8e1f-51a445b0d399 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:57.870011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:57.870734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:57.871077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:57.871352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:57.872098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:57.874262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:57.902595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:57.933924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:57.935735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:57.962202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 828/1659] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:57 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:57.964116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:58.147290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeb53f-996b-41d0-ae0e-29a7e6ccea4b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:58.153127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:58.164661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:58.174388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6531a-f9b8-42fb-bd69-80c46991e507 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:58.178769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.179232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.179661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.180716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:58.187294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:58.239395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 829/1660] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:57 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:58.244328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:58.272798 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1138a-32f1-4c51-bd57-acc73f2147b9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:58.357457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:58.357457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.357457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.357457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.357751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:58.372023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:58.393280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 830/1661] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:58.397020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:58.402946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908376b-3511-4198-a3d3-d768cb0fe699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:58.403783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908376b-3511-4198-a3d3-d768cb0fe699 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.404160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908376b-3511-4198-a3d3-d768cb0fe699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.404532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908376b-3511-4198-a3d3-d768cb0fe699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.414227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9587-b89b-41e9-9de1-c350bf3e2ce0 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:58.419572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:58.420738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.421160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.421720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.422709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:58.424491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:58.428999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908376b-3511-4198-a3d3-d768cb0fe699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:58.434770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908376b-3511-4198-a3d3-d768cb0fe699 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:58.441943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 831/1662] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:13:58.447659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:58.462764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 832/1663] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:13:58.470337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955740-a4a3-45aa-a033-dbc2f3952761 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:58.482383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:58.483301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.483572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.483837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] PATH_INFO: `/v3/projects/0b2f787d68f143188c3fe4adde8bb22c/users/96e2030fd55740e9b849bfe363137d02/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.529750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2f787d68f143188c3fe4adde8bb22c, user_id=96e2030fd55740e9b849bfe363137d02, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:58.532703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:58.568967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 832/1664] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:58 2022] PUT /identity/v3/projects/0b2f787d68f143188c3fe4adde8bb22c/users/96e2030fd55740e9b849bfe363137d02/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:58.571938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.572307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.572883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.587197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:58.589718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:58.682255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] MFA Rules not processed for user `96e2030fd55740e9b849bfe363137d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:58.686191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:58.797055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a60a6-2ee5-48dc-b95a-9002a098d1f2 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:58.810218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:58.820056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:58.820819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:58.828362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] PATH_INFO: `/v3/projects/4596e83dcd3b47118c3500da1df3a176` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:58.831719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4596e83dcd3b47118c3500da1df3a176)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:58.834638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:58.939789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 833/1665] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:58.944566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:58.946166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:58.988969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512ed42-229c-428f-b7e5-b735999cd760 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.004586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4596e83dcd3b47118c3500da1df3a176', 'request_id': 'req-2172cdb7-7742-4087-9270-89268511d5b5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:59.014811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4596e83dcd3b47118c3500da1df3a176', 'request_id': 'req-2172cdb7-7742-4087-9270-89268511d5b5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:59.028263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4596e83dcd3b47118c3500da1df3a176', 'request_id': 'req-2172cdb7-7742-4087-9270-89268511d5b5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:59.059223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] The token cache is being invalidate because project 4596e83dcd3b47118c3500da1df3a176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:13:59.059592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:59.060292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-2172cdb7-7742-4087-9270-89268511d5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:13:59.066304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 833/1666] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:13:58 2022] DELETE /identity/v3/projects/4596e83dcd3b47118c3500da1df3a176 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:13:59.073561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fd1b-1964-42b3-a649-6d7f9d5c8dd7 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.074043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fd1b-1964-42b3-a649-6d7f9d5c8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.080074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fd1b-1964-42b3-a649-6d7f9d5c8dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.141879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-39c8fd1b-1964-42b3-a649-6d7f9d5c8dd7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:59.144639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-39c8fd1b-1964-42b3-a649-6d7f9d5c8dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:59.233306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.234018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.234295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.234563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.235301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.237262 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:59.281833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 834/1667] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:59.307018 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.307319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.307710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.320475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 834/1668] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:59.324006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.328295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:59.365961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:13:59.371501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:13:59.386172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:59.513452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8a1f6-784f-4d70-9f66-40521effae72 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.528699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.529810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.529810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.529993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.530699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.533314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:59.546434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 835/1669] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:13:59.547359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.571689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa710c-d370-4505-992a-1c2d607f4d22 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.584896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 835/1670] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:59 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:59.587077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.587811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.588036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.588311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.589942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:13:59.591082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.592004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:59.594472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.625565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 836/1671] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:13:59.626230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.636761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf997d2-8496-4705-add8-5c9b195e4df5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.654172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd40e-fdd5-485c-a6b7-54a7c99de708 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.662412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.662412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.662743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.663057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.663540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.663663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.664306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.664573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.664842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.665946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:59.666066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.667718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:59.689434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 836/1672] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:13:59.693405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.711658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e6e02-70f6-4e91-99d2-984dedbc1806 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.724348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.725390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.725670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.725992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] PATH_INFO: `/v3/projects/a12a5acf6d6447f2b8edd0f250719386/users/ab4e4ed562884714930aa144cf808744/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.739276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 837/1673] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:13:59 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:13:59.743316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.767105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12a5acf6d6447f2b8edd0f250719386, user_id=ab4e4ed562884714930aa144cf808744, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.769909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:13:59.798717 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 837/1674] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:13:59 2022] PUT /identity/v3/projects/a12a5acf6d6447f2b8edd0f250719386/users/ab4e4ed562884714930aa144cf808744/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:13:59.802869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:13:59.818970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:59.895423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8868-ad24-4c44-bb7d-6926bf9a7780 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.956704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a6c86-0346-4f42-b1d3-c315b38ea8d7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:13:59.967726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:13:59.968489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:13:59.968771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:13:59.968971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:13:59.973459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:13:59.975140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.003350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 838/1675] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:00.004545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:00.026673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56516-b538-40e2-bd1f-d24d0f8f2106 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:00.042246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.043417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.043703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.043980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] PATH_INFO: `/v3/projects/a12a5acf6d6447f2b8edd0f250719386/users/ab4e4ed562884714930aa144cf808744/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.047917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3527159-9409-41af-8573-5bbcbb21c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.049497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527159-9409-41af-8573-5bbcbb21c44e admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.049570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527159-9409-41af-8573-5bbcbb21c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.049857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12a5acf6d6447f2b8edd0f250719386, user_id=ab4e4ed562884714930aa144cf808744, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:00.049964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527159-9409-41af-8573-5bbcbb21c44e admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.050799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3527159-9409-41af-8573-5bbcbb21c44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:00.053023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3527159-9409-41af-8573-5bbcbb21c44e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.054799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.094863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 839/1676] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:00 2022] PUT /identity/v3/projects/a12a5acf6d6447f2b8edd0f250719386/users/ab4e4ed562884714930aa144cf808744/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:00.095177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 838/1677] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:13:59 2022] POST /identity/v3/users => generated 282 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:00.099050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.100745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.101634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:00.101902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.209206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] MFA Rules not processed for user `ab4e4ed562884714930aa144cf808744`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:00.212665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:00.238490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:00.243869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce227e-7fd1-486b-a720-097ad54d228c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:00.264760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.265500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.265876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.266081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.267077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:00.268744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.300879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 840/1678] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:00.304698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:00.322043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bad5-50d5-4aa1-87cb-2c4cb9e4fdd3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:00.337516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.338216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.338880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.340178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.340865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:00.342727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.368749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 841/1679] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:00.373576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:00.394883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aedad-ef9a-48ac-a5d5-587356174482 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:00.409987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.410940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.412118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.412118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] PATH_INFO: `/v3/projects/5a19e895b78c4a208be7d7bd502063a5/users/89095a0c237246ba8ed34e1b485634ee/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.449657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a19e895b78c4a208be7d7bd502063a5, user_id=89095a0c237246ba8ed34e1b485634ee, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:00.457278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.464015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 839/1680] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:00.478661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:00.483403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:00.490310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 842/1681] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:00 2022] PUT /identity/v3/projects/5a19e895b78c4a208be7d7bd502063a5/users/89095a0c237246ba8ed34e1b485634ee/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:00.501535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:00.503404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:00.650855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a49da-164e-4253-9cbc-f1f7aeff84d9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:00.659824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.660735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.661017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.661310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] PATH_INFO: `/v3/users/d5ec6bd7834c4bcb804fadd742162484` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.670190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ec6bd7834c4bcb804fadd742162484)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:00.672179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:00.694632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:00.710600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ad272-e04c-4692-8ea1-5d5aa7af0c2d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:00.772967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ec6bd7834c4bcb804fadd742162484'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:00.798730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ec6bd7834c4bcb804fadd742162484'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:00.799950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ec6bd7834c4bcb804fadd742162484'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:00.800865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ec6bd7834c4bcb804fadd742162484'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:00.824905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f381ae7-fbcf-4a13-9093-cc9e0db7641e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ec6bd7834c4bcb804fadd742162484'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:00.848345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 843/1682] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:00 2022] DELETE /identity/v3/users/d5ec6bd7834c4bcb804fadd742162484 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:00.854997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4505-4c58-41e1-89d0-4995339e285c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.855293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4505-4c58-41e1-89d0-4995339e285c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.857734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4505-4c58-41e1-89d0-4995339e285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.898408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:00.899508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:00.904322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:00.904638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:00.909170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:00.914351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2aee4505-4c58-41e1-89d0-4995339e285c None None] MFA Rules not processed for user `89095a0c237246ba8ed34e1b485634ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:00.917084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2aee4505-4c58-41e1-89d0-4995339e285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:00.985052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:01.083491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 844/1683] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:01.085191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:01.085507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:01.085779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:01.097646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:01.099935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048ccf4-ae67-432a-885c-aa5bdbd0fb9a service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:01.116476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 840/1684] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:01.118000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:01.118294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:01.118570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:01.147015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] MFA Rules not processed for user `dcf8635a22eb4c829a7a99ce4f9fb379`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:01.148242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.160248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:01.168684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.298047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 845/1685] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:01.299002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:01.307181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 841/1686] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:01.308217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:01.314906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.315128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.334917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ddf06-6078-4ad8-a0fd-8b5de973f7de None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:01.341569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b34a7-d0f5-4159-8131-917d6eaae405 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:01.349881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:01.350790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:01.351066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:01.351341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] PATH_INFO: `/v3/projects/979c722a06cc41cd923085150e9f1e6b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:01.352540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979c722a06cc41cd923085150e9f1e6b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:01.354652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:01.355177 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:01.356004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:01.356404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:01.356633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:01.358055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:01.366224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:01.416968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 846/1687] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:01 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:01.417988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:01.424793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.458331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979c722a06cc41cd923085150e9f1e6b', 'request_id': 'req-0d5071a8-4e6e-423e-b389-0b67f8667670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:01.460079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:01.470405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979c722a06cc41cd923085150e9f1e6b', 'request_id': 'req-0d5071a8-4e6e-423e-b389-0b67f8667670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:01.483087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979c722a06cc41cd923085150e9f1e6b', 'request_id': 'req-0d5071a8-4e6e-423e-b389-0b67f8667670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:01.507603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] The token cache is being invalidate because project 979c722a06cc41cd923085150e9f1e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:01.507940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:01.510120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:01.512235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 842/1688] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:01 2022] DELETE /identity/v3/projects/979c722a06cc41cd923085150e9f1e6b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:01.513184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:01.516476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.635501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28122c9-6d07-46c7-b990-b364ff0fdaa5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:01.726447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5071a8-4e6e-423e-b389-0b67f8667670 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:01.749830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:01.750569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:01.750848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:01.751133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:01.755765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:01.764438 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:01.821515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:01.826158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:01.826598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:01.826985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] PATH_INFO: `/v3/users/96e2030fd55740e9b849bfe363137d02` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:01.832126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e2030fd55740e9b849bfe363137d02)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:01.835518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:01.973546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:01.975189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:01.989671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e2030fd55740e9b849bfe363137d02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:02.002785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 843/1689] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:02.004378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.006769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.020925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e2030fd55740e9b849bfe363137d02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:02.022476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e2030fd55740e9b849bfe363137d02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:02.023194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e2030fd55740e9b849bfe363137d02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:02.037629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e2030fd55740e9b849bfe363137d02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:02.062987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 847/1690] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:01 2022] DELETE /identity/v3/users/96e2030fd55740e9b849bfe363137d02 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:02.063851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.070134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.170048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab48f45-c9ed-493f-8a1c-b3c992cdf981 service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.280106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:02.288527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803d7b8-41a5-4cc8-bb4d-ccaf0ff69af5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.304659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbd515-cd52-41be-ac32-a42bc479918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.305414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd515-cd52-41be-ac32-a42bc479918d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.305683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd515-cd52-41be-ac32-a42bc479918d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.305956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd515-cd52-41be-ac32-a42bc479918d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.308895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbd515-cd52-41be-ac32-a42bc479918d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.310991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbd515-cd52-41be-ac32-a42bc479918d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.348227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.348894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.349171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.357722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.360940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.391037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 848/1691] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:02 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:02.395271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.395560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.395835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.401122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.403039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8494-a399-4b71-bb31-69c891b87c40 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.440733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 844/1692] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:02.442238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8d2b-ff6a-49b8-9ca2-7a5b424ff677 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.442526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8d2b-ff6a-49b8-9ca2-7a5b424ff677 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.442799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8d2b-ff6a-49b8-9ca2-7a5b424ff677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.461659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:02.463222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.477545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 849/1693] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:02.480536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.501335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9bc1-0a27-468c-8357-0ae81f8688e5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.506600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-142b8d2b-ff6a-49b8-9ca2-7a5b424ff677 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:02.507127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.507401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.507570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.507818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.507925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-142b8d2b-ff6a-49b8-9ca2-7a5b424ff677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.508552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.510265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.524022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 845/1694] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:02.529847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.530174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.530406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.540911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 850/1695] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:02.545181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.572587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605965d8-c40d-4553-b56b-aa56fbe72b66 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.575134 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:02.578617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.591246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.592783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.593073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.593402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] PATH_INFO: `/v3/projects/1a675609eec74b509f22f09fcebf8e24/users/e88318cb6b084fe98d1d785d44981689/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.608089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 846/1696] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:02.609102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.618600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:02.646614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b81b-645f-4e20-8986-8bb9136347e8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.648297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a675609eec74b509f22f09fcebf8e24, user_id=e88318cb6b084fe98d1d785d44981689, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.651595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.652572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.652673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.652673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.652976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.674360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.681370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.682055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 851/1697] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:02 2022] PUT /identity/v3/projects/1a675609eec74b509f22f09fcebf8e24/users/e88318cb6b084fe98d1d785d44981689/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:02.682992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.706631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 847/1698] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:02.707557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.724942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b45c4f-6f59-4ceb-a732-f4202ff659f4 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.731821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:02.860330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.861043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.861349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.861627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.861741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f2b02-6964-411d-afc2-dd6b89e842ed admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.862778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.867428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.872336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.873268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.873972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.873972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.875298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:02.875751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.877961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.893749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 848/1699] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:02.898467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.909373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 852/1700] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:02.916033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:02.924063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c89983-8b21-42c0-ab0e-4b0535420cf7 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.930337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6fca-5f50-464f-9188-6890f16bf14e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:02.935409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fa90f-d7b1-4228-9ae7-2a25e099488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.936334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fa90f-d7b1-4228-9ae7-2a25e099488b admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.936616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fa90f-d7b1-4228-9ae7-2a25e099488b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.936889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fa90f-d7b1-4228-9ae7-2a25e099488b admin admin] PATH_INFO: `/v3/projects/1a675609eec74b509f22f09fcebf8e24/users/e88318cb6b084fe98d1d785d44981689/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.937597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:02.938539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.939406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.939855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:02.940804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.944623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fa90f-d7b1-4228-9ae7-2a25e099488b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a675609eec74b509f22f09fcebf8e24, user_id=e88318cb6b084fe98d1d785d44981689, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:02.947402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fa90f-d7b1-4228-9ae7-2a25e099488b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.948584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:02.978973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 849/1701] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:02 2022] PUT /identity/v3/projects/1a675609eec74b509f22f09fcebf8e24/users/e88318cb6b084fe98d1d785d44981689/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:02.981290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:02.981651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:02.981864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.015702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 853/1702] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:02 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:03.024119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:03.047255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] MFA Rules not processed for user `e88318cb6b084fe98d1d785d44981689`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:03.049480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:03.177954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3900-8694-4648-bc93-a69ff7faf752 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:03.192875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:03.193853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:03.194023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:03.195572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.196510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:03.201729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:03.243263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 850/1703] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:03.259759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:03.261302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 854/1704] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:03 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:03.262041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:03.265444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:03.290362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af054d-cc7c-4a97-a447-dfb303eb0c9b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:03.317512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:03.324687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:03.328688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:03.328971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:03.334759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.335806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:03.342864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:03.370584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2daa-8134-4d10-a1ca-618a0671e927 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:03.375791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:03.376087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 855/1705] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:03.376881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:03.377185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:03.377490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.380688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:03.390303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:03.391806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:03.404548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 851/1706] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:03.420011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d1e7-6f16-4ac7-9338-471893bba1f5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:03.448825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d3287-f96f-4043-994a-753193802f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:03.451369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d3287-f96f-4043-994a-753193802f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:03.451656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d3287-f96f-4043-994a-753193802f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:03.451938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d3287-f96f-4043-994a-753193802f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.452695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d3287-f96f-4043-994a-753193802f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:03.465531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d3287-f96f-4043-994a-753193802f8a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:03.523965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 856/1707] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:03.525969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:03.542756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ec011-670f-42a7-b5e9-b8f91b33bbd1 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:03.558157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:03.559404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:03.559855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:03.560236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] PATH_INFO: `/v3/projects/f371d8f58dc04952aba7c4d80cf7fcd1/users/e3ae00e184bd4e67a8642fb4335ddf35/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.614500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f371d8f58dc04952aba7c4d80cf7fcd1, user_id=e3ae00e184bd4e67a8642fb4335ddf35, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:03.617335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:03.646092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 852/1708] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:03 2022] PUT /identity/v3/projects/f371d8f58dc04952aba7c4d80cf7fcd1/users/e3ae00e184bd4e67a8642fb4335ddf35/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:03.647933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:03.648226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:03.648504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:03.740914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] MFA Rules not processed for user `e3ae00e184bd4e67a8642fb4335ddf35`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:03.742222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:03.898819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:03.988251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 857/1709] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:03.990513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:04.178162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f99f8-8685-4c82-bafc-ecca0f224d76 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:04.188748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:04.189560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:04.189998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:04.190383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:04.191108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:04.194771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:04.243194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 853/1710] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:03 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:04.244403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:04.269212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6682e6-1044-41c8-97d2-2f52ea91497f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:04.312877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:04.314765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:04.480797 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:04.481536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:04.482292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:04.482591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:04.483297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:04.485300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:04.540282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 858/1711] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:04 2022] POST /identity/v3/users => generated 299 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:04.541365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:04.565518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a25e-c251-4bbf-8ac3-18f9bccd79a4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:04.589180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:04.590133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:04.590414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:04.590694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] PATH_INFO: `/v3/users/89095a0c237246ba8ed34e1b485634ee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:04.594454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89095a0c237246ba8ed34e1b485634ee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:04.596440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:04.608646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d027d-3e57-4549-9463-4045217006ff admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:04.642168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:04.643004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:04.683694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:04.686472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] PATH_INFO: `/v3/projects/0b2f787d68f143188c3fe4adde8bb22c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:04.692887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2f787d68f143188c3fe4adde8bb22c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:04.699267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89095a0c237246ba8ed34e1b485634ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:04.704445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:04.731903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89095a0c237246ba8ed34e1b485634ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:04.732690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89095a0c237246ba8ed34e1b485634ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:04.733354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89095a0c237246ba8ed34e1b485634ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:04.750343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89095a0c237246ba8ed34e1b485634ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:04.773057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 859/1712] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:04 2022] DELETE /identity/v3/users/89095a0c237246ba8ed34e1b485634ee => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:04.776160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:04.782203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:04.878724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:04.896533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:04.998852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68702ee0-4dcb-4f6a-a84d-fb7b051ec9fd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:05.068655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2f787d68f143188c3fe4adde8bb22c', 'request_id': 'req-54da513a-66f4-4831-ba18-3315357cfb02'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.091360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2f787d68f143188c3fe4adde8bb22c', 'request_id': 'req-54da513a-66f4-4831-ba18-3315357cfb02'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.121845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2f787d68f143188c3fe4adde8bb22c', 'request_id': 'req-54da513a-66f4-4831-ba18-3315357cfb02'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.146671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:05.147533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.147914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.148283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.149110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:05.155197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:05.156508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] The token cache is being invalidate because project 0b2f787d68f143188c3fe4adde8bb22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:05.157963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.159881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-54da513a-66f4-4831-ba18-3315357cfb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.167346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 854/1713] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:04 2022] DELETE /identity/v3/projects/0b2f787d68f143188c3fe4adde8bb22c => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:05.171515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.171759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.172067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.178783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 860/1714] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:05.190272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:05.192850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.211968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80cfab-696f-4df3-bf70-1feee25e56cc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:05.222891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:05.225262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.228912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:05.230099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.230477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.230843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] PATH_INFO: `/v3/users/ab4e4ed562884714930aa144cf808744` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.232291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4e4ed562884714930aa144cf808744)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:05.234327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:05.243436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 855/1715] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:05.251126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:05.255946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.300314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1433d21-eed4-4122-a41c-1428bcf75a79 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:05.322242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:05.323681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.328095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.328425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] PATH_INFO: `/v3/projects/005e8156cc224201b211a9b6c2dc9d0c/users/2198ea5b83b041f9941123d71bd56d48/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.340799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4e4ed562884714930aa144cf808744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.372165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4e4ed562884714930aa144cf808744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.374543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005e8156cc224201b211a9b6c2dc9d0c, user_id=2198ea5b83b041f9941123d71bd56d48, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:05.375170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4e4ed562884714930aa144cf808744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.376851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4e4ed562884714930aa144cf808744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.378737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:05.397411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-465548dd-fd23-4ff6-a71c-8ec6d9fc0369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4e4ed562884714930aa144cf808744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:05.411429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 856/1716] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:05 2022] PUT /identity/v3/projects/005e8156cc224201b211a9b6c2dc9d0c/users/2198ea5b83b041f9941123d71bd56d48/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:05.413022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:05.419986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.424620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 861/1717] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:05 2022] DELETE /identity/v3/users/ab4e4ed562884714930aa144cf808744 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:05.426234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.426521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.426798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.477186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] MFA Rules not processed for user `375a65c49fe843538ff349221800cf30`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:05.478550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.590557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53a36-d35b-4288-8068-ec1d71b658e3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:05.600608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:05.663337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 862/1718] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:05.664373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:05.670187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.769514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:05.770391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.770783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.771160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.779272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:05.925358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda726e-7992-4cca-8e1d-5309ff1c9519 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:05.949307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:05.957386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:05.958169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:05.958550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:05.958993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:05.959945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:05.962537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:05.990217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:05.999925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088430-3656-4825-8b04-757df4bf7b02 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:06.004885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 863/1719] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:06.013710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 857/1720] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:06.014611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:06.015213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.015605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.015985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.016419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.056008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] MFA Rules not processed for user `d0db4cc91baa4721b5c6d750eeddf9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:06.057090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.217032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c102a-cb6c-4c67-baca-e4a859b3d245 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:06.234233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:06.234935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.235198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.235470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.253158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:06.253702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 858/1721] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:06.254902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:06.255401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:06.278347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 864/1722] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:06.279518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:06.285047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.326166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845840dd-7e8f-42bb-a5e3-41d7ff22ea45 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:06.337267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f106d-1001-4bc0-9748-20a63e849b71 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:06.339275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d3ed-e4e9-485b-a610-a6b747b3c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:06.340377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d3ed-e4e9-485b-a610-a6b747b3c175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.340658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d3ed-e4e9-485b-a610-a6b747b3c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.340928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d3ed-e4e9-485b-a610-a6b747b3c175 admin admin] PATH_INFO: `/v3/projects/005e8156cc224201b211a9b6c2dc9d0c/users/2198ea5b83b041f9941123d71bd56d48/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.355873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d3ed-e4e9-485b-a610-a6b747b3c175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005e8156cc224201b211a9b6c2dc9d0c, user_id=2198ea5b83b041f9941123d71bd56d48, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:06.356758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:06.357874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.358292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.358721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] PATH_INFO: `/v3/projects/dbe19f6f4fde417497eddf8ec34438a2` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.358860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d3ed-e4e9-485b-a610-a6b747b3c175 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:06.369422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe19f6f4fde417497eddf8ec34438a2)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:06.372638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:06.388956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 859/1723] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:06 2022] PUT /identity/v3/projects/005e8156cc224201b211a9b6c2dc9d0c/users/2198ea5b83b041f9941123d71bd56d48/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:06.393420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.393587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.394257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.436471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] MFA Rules not processed for user `d0db4cc91baa4721b5c6d750eeddf9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:06.449000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.493526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe19f6f4fde417497eddf8ec34438a2', 'request_id': 'req-3729326b-3bbf-4692-9608-4dbbb47ac019'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:06.514415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe19f6f4fde417497eddf8ec34438a2', 'request_id': 'req-3729326b-3bbf-4692-9608-4dbbb47ac019'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:06.520031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:06.534222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe19f6f4fde417497eddf8ec34438a2', 'request_id': 'req-3729326b-3bbf-4692-9608-4dbbb47ac019'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:06.562502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] The token cache is being invalidate because project dbe19f6f4fde417497eddf8ec34438a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:06.565515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:06.566894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3729326b-3bbf-4692-9608-4dbbb47ac019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:06.574578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 865/1724] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:06 2022] DELETE /identity/v3/projects/dbe19f6f4fde417497eddf8ec34438a2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:06.583175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.583465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.583782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.603993 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 860/1725] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:06.605693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:06.607215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.662523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] MFA Rules not processed for user `2198ea5b83b041f9941123d71bd56d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:06.664682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.839170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982db51c-5ac1-4fce-aea6-30d9dd754b17 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:06.861028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:06.867708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 866/1726] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:06.871182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:06.876095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:06.980910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:06.985338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:06.985584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:06.987974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] PATH_INFO: `/v3/users/a0b68bdb0f59428787462f1e162a0a19` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:06.990515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b68bdb0f59428787462f1e162a0a19)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:06.992513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:07.044330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83abe-4683-4eb0-8a44-49e4579a1278 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:07.071776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:07.072565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:07.073103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:07.073564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:07.090655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.131320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b68bdb0f59428787462f1e162a0a19'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.164299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b68bdb0f59428787462f1e162a0a19'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.164684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b68bdb0f59428787462f1e162a0a19'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.165331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b68bdb0f59428787462f1e162a0a19'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.192489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3df32d1-feec-4690-9a41-bfc1a434c500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b68bdb0f59428787462f1e162a0a19'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.225465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 861/1727] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:06 2022] DELETE /identity/v3/users/a0b68bdb0f59428787462f1e162a0a19 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:07.233046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:07.234611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:07.236151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:07.265160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:07.270101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:07.294471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 867/1728] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:07.295456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:07.298725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] MFA Rules not processed for user `5ed9d1c1ec4f419898831b7557b93693`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:07.299969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.301373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.353860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:07.497551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ac07-08c4-4896-a85e-87fb1151e17b service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:07.501314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 862/1729] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:07.502431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:07.503896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.583011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:07.606818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:07.609654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:07.610109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:07.610394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:07.612621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.678834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481962d7-f4c7-4e07-8491-c24dfe019008 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:07.687071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:07.688233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:07.688520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:07.688841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] PATH_INFO: `/v3/projects/5a19e895b78c4a208be7d7bd502063a5` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:07.692140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a19e895b78c4a208be7d7bd502063a5)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:07.694770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:07.794076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:07.798987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbc811-50b3-4e8d-881b-37bbadfb7789 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:07.810719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a19e895b78c4a208be7d7bd502063a5', 'request_id': 'req-76c302f7-f21b-4ff6-96fd-f5d76d701912'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.811400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 868/1730] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:07.817951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a19e895b78c4a208be7d7bd502063a5', 'request_id': 'req-76c302f7-f21b-4ff6-96fd-f5d76d701912'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.827506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:07.827792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:07.828066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:07.840858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a19e895b78c4a208be7d7bd502063a5', 'request_id': 'req-76c302f7-f21b-4ff6-96fd-f5d76d701912'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.867180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] The token cache is being invalidate because project 5a19e895b78c4a208be7d7bd502063a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:07.872109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] MFA Rules not processed for user `5ed9d1c1ec4f419898831b7557b93693`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:07.873560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.873754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.874678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:07.876876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 863/1731] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:07 2022] DELETE /identity/v3/projects/5a19e895b78c4a208be7d7bd502063a5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:07.880840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:07.882772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.983226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 869/1732] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:07.985314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:07.995834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:07.998444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c302f7-f21b-4ff6-96fd-f5d76d701912 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:08.005612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:08.007429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.007929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.009585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] PATH_INFO: `/v3/users/e88318cb6b084fe98d1d785d44981689` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.012795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88318cb6b084fe98d1d785d44981689)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:08.015768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:08.016992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd28bc-0279-4780-84af-4da31859a159 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:08.022917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:08.024202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.024633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.025038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] PATH_INFO: `/v3/users/e3ae00e184bd4e67a8642fb4335ddf35` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.037126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ae00e184bd4e67a8642fb4335ddf35)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:08.039962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:08.067767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:08.131195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88318cb6b084fe98d1d785d44981689'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.141386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:08.144604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ae00e184bd4e67a8642fb4335ddf35'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.151358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88318cb6b084fe98d1d785d44981689'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.152389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88318cb6b084fe98d1d785d44981689'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.154232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88318cb6b084fe98d1d785d44981689'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.165354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88318cb6b084fe98d1d785d44981689'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.168394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ae00e184bd4e67a8642fb4335ddf35'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.169639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ae00e184bd4e67a8642fb4335ddf35'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.170990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ae00e184bd4e67a8642fb4335ddf35'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.197212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1b8013c-0d07-4b8d-bf58-522415e0d20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ae00e184bd4e67a8642fb4335ddf35'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.200407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 864/1733] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:07 2022] DELETE /identity/v3/users/e88318cb6b084fe98d1d785d44981689 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:08.201500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:08.203153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.234485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 870/1734] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:07 2022] DELETE /identity/v3/users/e3ae00e184bd4e67a8642fb4335ddf35 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:08.241461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.241808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.242435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.316799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:08.318923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.390571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d3efc-5a39-4b73-aae6-0d591ba664a9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:08.476720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 871/1735] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:08.478407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:08.480033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.535904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:08.536581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.536860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.537133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.542576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.560702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2c293-d695-4f0b-85b4-d4761629ead0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:08.580786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:08.581983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.582280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.582540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] PATH_INFO: `/v3/projects/a12a5acf6d6447f2b8edd0f250719386` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.585807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12a5acf6d6447f2b8edd0f250719386)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:08.590292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:08.662895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:08.665390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:08.685605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 865/1736] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:08.686847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:08.694162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.696537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12a5acf6d6447f2b8edd0f250719386', 'request_id': 'req-c12c7394-233f-46fe-81fe-0933d94479f5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.705759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12a5acf6d6447f2b8edd0f250719386', 'request_id': 'req-c12c7394-233f-46fe-81fe-0933d94479f5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.720404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12a5acf6d6447f2b8edd0f250719386', 'request_id': 'req-c12c7394-233f-46fe-81fe-0933d94479f5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.727924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3bc0-4af6-41ba-968e-13f4c90370ad service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:08.742093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:08.748704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] The token cache is being invalidate because project a12a5acf6d6447f2b8edd0f250719386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:08.748994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.749891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:08.756100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 872/1737] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:08 2022] DELETE /identity/v3/projects/a12a5acf6d6447f2b8edd0f250719386 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:08.756100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:08.758014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.788773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:08.870355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:08.871958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.872248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.872505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] PATH_INFO: `/v3/projects/9fb0a84adf394bf095d46f17522633fa` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.873796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb0a84adf394bf095d46f17522633fa)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:08.876033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:08.894894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7394-233f-46fe-81fe-0933d94479f5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:08.900981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:08.909090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.909427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.909747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.912379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:08.928835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:08.930677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f857b7-d902-4b6c-934a-ac8a521b9f88 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:08.945306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 873/1738] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:08.946938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b87b-7e52-4cc9-a42c-a6ad9c80871f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.947230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b87b-7e52-4cc9-a42c-a6ad9c80871f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.947496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b87b-7e52-4cc9-a42c-a6ad9c80871f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:08.973631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 874/1739] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 20 09:14:08 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:14:08.979658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199f9a2-64d6-45ff-a8a5-8c5dbe1e72cb None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:08.980123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199f9a2-64d6-45ff-a8a5-8c5dbe1e72cb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:08.980407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199f9a2-64d6-45ff-a8a5-8c5dbe1e72cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.017082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb0a84adf394bf095d46f17522633fa', 'request_id': 'req-e2de59dc-e876-4ce5-90b1-d8011eeecd80'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.033349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1199f9a2-64d6-45ff-a8a5-8c5dbe1e72cb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:09.034089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb0a84adf394bf095d46f17522633fa', 'request_id': 'req-e2de59dc-e876-4ce5-90b1-d8011eeecd80'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.034738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1199f9a2-64d6-45ff-a8a5-8c5dbe1e72cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.047872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb0a84adf394bf095d46f17522633fa', 'request_id': 'req-e2de59dc-e876-4ce5-90b1-d8011eeecd80'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.070352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] The token cache is being invalidate because project 9fb0a84adf394bf095d46f17522633fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:09.070694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.071432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e2de59dc-e876-4ce5-90b1-d8011eeecd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.073782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 866/1740] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:08 2022] DELETE /identity/v3/projects/9fb0a84adf394bf095d46f17522633fa => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:09.075335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb72aa-3d0f-4525-a899-1bffb2619e89 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.075675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb72aa-3d0f-4525-a899-1bffb2619e89 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.077491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb72aa-3d0f-4525-a899-1bffb2619e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.116081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-dbfb72aa-3d0f-4525-a899-1bffb2619e89 None None] MFA Rules not processed for user `dcf8635a22eb4c829a7a99ce4f9fb379`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:09.129214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dbfb72aa-3d0f-4525-a899-1bffb2619e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.191694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 875/1741] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:09.194151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.194448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.194724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.293696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 867/1742] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:09.295175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441445-3b60-4b5f-b5f8-504ba9955eaa None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.295464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441445-3b60-4b5f-b5f8-504ba9955eaa None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.295736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441445-3b60-4b5f-b5f8-504ba9955eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.302222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:09.303482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.344827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9d441445-3b60-4b5f-b5f8-504ba9955eaa None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:09.348347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9d441445-3b60-4b5f-b5f8-504ba9955eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.390546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 868/1743] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:09.392153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d87188-35b9-408b-a961-c37030745f9d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.392444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d87188-35b9-408b-a961-c37030745f9d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.392722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d87188-35b9-408b-a961-c37030745f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.459647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-19d87188-35b9-408b-a961-c37030745f9d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:09.460894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-19d87188-35b9-408b-a961-c37030745f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.490399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 869/1744] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:09.491423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 876/1745] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:09.493565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:09.494362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.494821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.495163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.497408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.534778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a07cd-1836-4c0f-b72b-901746576914 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:09.539950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:09.540850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.541187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.541819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] PATH_INFO: `/v3/projects/1a675609eec74b509f22f09fcebf8e24` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.543694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a675609eec74b509f22f09fcebf8e24)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:09.548151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:09.549426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:09.561968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.591754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 870/1746] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:09.597466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:09.618471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735f823-1c35-49d6-a305-849747c0c020 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:09.632299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:09.633887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.634175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.634451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.638782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:09.640250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:09.642257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:09.668367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 871/1747] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:09.669533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:09.674446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.695501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7845c6-2a8e-4cac-8a32-f56ad00aff54 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:09.695724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a675609eec74b509f22f09fcebf8e24', 'request_id': 'req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.703823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:09.712297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:09.725616 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a675609eec74b509f22f09fcebf8e24', 'request_id': 'req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.735772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a675609eec74b509f22f09fcebf8e24', 'request_id': 'req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.772764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] The token cache is being invalidate because project 1a675609eec74b509f22f09fcebf8e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:09.773252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.775272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:09.783654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 877/1748] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:09 2022] DELETE /identity/v3/projects/1a675609eec74b509f22f09fcebf8e24 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:09.785796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:09.788532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.874031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:09.877143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.878207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.878683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.885913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.921648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:09.926421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:09.954624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 872/1749] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:09.955657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:09.958026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:09.990494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e31bf4-0f57-40bf-b4f2-ce01214a5ab3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:09.996175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:09.996871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:09.997154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:09.997459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:09.998548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:09.999103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.002391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828aa45-7ca3-4e5f-993f-c332546cccc8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.012442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766f297-830d-4991-8bac-8dc53118a22e service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.030053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.030768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.031051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.031324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.033733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.034004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.044765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 878/1750] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:10.046062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.046418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.046715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.117843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 873/1751] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:09 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:10.117843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.118969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:10.120910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:10.314198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d79e-5a36-44d2-8fdc-77f8f26f2517 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.333768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 879/1752] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:10.334819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.346589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c640f8-26b8-44a8-9913-206132645412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.347388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c640f8-26b8-44a8-9913-206132645412 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.347649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c640f8-26b8-44a8-9913-206132645412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.347937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c640f8-26b8-44a8-9913-206132645412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.348742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c640f8-26b8-44a8-9913-206132645412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.351033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c640f8-26b8-44a8-9913-206132645412 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.376046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddfcc1-204d-4cd1-8161-13a3ea3d2624 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.393985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.394771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.395074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.395343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.396052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.400701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.415344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 874/1753] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:10 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:10.417828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d829c2c-3d24-477b-84cc-6552a61ad324 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.418159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d829c2c-3d24-477b-84cc-6552a61ad324 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.418436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d829c2c-3d24-477b-84cc-6552a61ad324 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.438123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 875/1754] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 20 09:14:10 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:14:10.441593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b16e-b407-48ae-bed7-37e78ecbf2d0 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.442013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b16e-b407-48ae-bed7-37e78ecbf2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.446430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b16e-b407-48ae-bed7-37e78ecbf2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.468658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 880/1755] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:10 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:10.471192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.488538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f64a-e47b-4e69-b908-91bb83334d82 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.517542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7fd2b16e-b407-48ae-bed7-37e78ecbf2d0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:10.519324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7fd2b16e-b407-48ae-bed7-37e78ecbf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:10.691685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:10.699364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 876/1756] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:10.700828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.701120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.701416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.730349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.731073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.731358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.731631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.733679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.735676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.740803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:10.742084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:10.765611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:10.780230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 881/1757] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:10 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:10.781531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.794626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d2fa-3bd1-4564-8eb9-988fb1c1243e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.806141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.810526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.812161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.812607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.814635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.821615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.848725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 882/1758] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:10.849798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.867811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be45a-3d4d-4a17-8061-7b67ae1fd251 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.881468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.883172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.883172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.883172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.883528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:10.883833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.892927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.918775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 877/1759] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:14:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:10.920200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.932440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 883/1760] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:10.933459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:10.948541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41561dc-5c1b-4ca1-83d6-5fb620d3b1a0 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:10.956471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:10.957263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:10.957631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:10.958080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:10.959035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:10.962592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:10.979333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620752c9-32e4-4bc4-8c28-ea90d4ee3038 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.006699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.007317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 878/1761] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:11.007397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.007686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.007782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.007963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.008707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.020103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ba26-296c-4bfd-8c89-9a2f16e7192e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.024561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.025540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.026509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.027471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.027759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.028490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.035753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.074363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 884/1762] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:11.074363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.084518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:11.131807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 879/1763] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:11 2022] POST /identity/v3/projects => generated 357 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:11.134151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.145668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a53af6-6841-4cee-9224-2b627ef8f8ea admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.233534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6001-9b59-42a4-b210-72d90209652e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.238889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.239763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.240050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.240756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.241630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.243313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.259590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 880/1764] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:11.259590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.269548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0507c-aa19-46c9-aca1-cc315010d8d8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.275199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.276629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.277932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.277932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] PATH_INFO: `/v3/projects/28675e89112d46ba81acb00bc127e090/users/1e23cac8d8a844fca2d452137ee40602/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.313075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28675e89112d46ba81acb00bc127e090, user_id=1e23cac8d8a844fca2d452137ee40602, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.317478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.341974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 881/1765] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:11 2022] PUT /identity/v3/projects/28675e89112d46ba81acb00bc127e090/users/1e23cac8d8a844fca2d452137ee40602/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:11.343452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.386566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337174-c9af-43f6-8be6-7debce74ae6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.387412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337174-c9af-43f6-8be6-7debce74ae6a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.388299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337174-c9af-43f6-8be6-7debce74ae6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.388695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337174-c9af-43f6-8be6-7debce74ae6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.401857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337174-c9af-43f6-8be6-7debce74ae6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.403837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337174-c9af-43f6-8be6-7debce74ae6a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.452863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 885/1766] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:11.458738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42feee-053a-4f8f-90b6-056aa5476d52 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.460296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42feee-053a-4f8f-90b6-056aa5476d52 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.460703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42feee-053a-4f8f-90b6-056aa5476d52 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.475196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 886/1767] 10.222.0.67 () {54 vars in 961 bytes} [Wed Jul 20 09:14:11 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:14:11.477853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42feee-053a-4f8f-90b6-056aa5476d52 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.502207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42feee-053a-4f8f-90b6-056aa5476d52 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.512128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5803-e59b-48a2-9d44-ffcb2115d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.514083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5803-e59b-48a2-9d44-ffcb2115d1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.514527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5803-e59b-48a2-9d44-ffcb2115d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.515760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5803-e59b-48a2-9d44-ffcb2115d1d4 admin admin] PATH_INFO: `/v3/projects/36551652b7dd4ee1b022b3a0bb3914b6/users/16e95f2fc4684a3483c8042087256d7b/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.527697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48312b3c-a6fb-4116-8d96-5296b447871d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:11.533768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb063e-2f9f-45c3-bc82-13825a9f38d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:11.534495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb063e-2f9f-45c3-bc82-13825a9f38d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.534928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb063e-2f9f-45c3-bc82-13825a9f38d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.535210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb063e-2f9f-45c3-bc82-13825a9f38d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.535916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb063e-2f9f-45c3-bc82-13825a9f38d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.537931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb063e-2f9f-45c3-bc82-13825a9f38d8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.563815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5803-e59b-48a2-9d44-ffcb2115d1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36551652b7dd4ee1b022b3a0bb3914b6, user_id=16e95f2fc4684a3483c8042087256d7b, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:11.569185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5803-e59b-48a2-9d44-ffcb2115d1d4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:11.575467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:11.610733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 882/1768] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:11 2022] POST /identity/v3/users => generated 279 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:11.612777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.613501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.613914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.667984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 887/1769] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:11 2022] PUT /identity/v3/projects/36551652b7dd4ee1b022b3a0bb3914b6/users/16e95f2fc4684a3483c8042087256d7b/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:11.673188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:11.673866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:11.674370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:11.723589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] MFA Rules not processed for user `1e23cac8d8a844fca2d452137ee40602`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:11.725052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:11.758325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:11.770632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:11.980187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 883/1770] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:11.981535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:11.983063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:11.999446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 888/1771] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Jul 20 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:12.000424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:12.083882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:12.174242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e10ca2-0f67-444f-9307-f3ecb5c0cc87 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:12.179318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b5260-2dc2-4e4e-ae25-8eb4db9d8640 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:12.186709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:12.188838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.189015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.194126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddfaf3-caab-45c3-9ab5-a58385c4f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:12.195439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] PATH_INFO: `/v3/projects/f371d8f58dc04952aba7c4d80cf7fcd1` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.197812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfaf3-caab-45c3-9ab5-a58385c4f844 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.198845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfaf3-caab-45c3-9ab5-a58385c4f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.199737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f371d8f58dc04952aba7c4d80cf7fcd1)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:12.200107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfaf3-caab-45c3-9ab5-a58385c4f844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.201771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:12.204238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddfaf3-caab-45c3-9ab5-a58385c4f844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:12.213682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddfaf3-caab-45c3-9ab5-a58385c4f844 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:12.239810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 889/1772] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:12.242126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.245602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.247106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.357829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f371d8f58dc04952aba7c4d80cf7fcd1', 'request_id': 'req-bba70af5-61a1-4216-a8cb-832919508f37'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:12.360173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] MFA Rules not processed for user `16e95f2fc4684a3483c8042087256d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:12.366961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f371d8f58dc04952aba7c4d80cf7fcd1', 'request_id': 'req-bba70af5-61a1-4216-a8cb-832919508f37'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:12.370933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:12.383525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f371d8f58dc04952aba7c4d80cf7fcd1', 'request_id': 'req-bba70af5-61a1-4216-a8cb-832919508f37'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:12.423813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] The token cache is being invalidate because project f371d8f58dc04952aba7c4d80cf7fcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:12.424403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:12.426087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:12.428974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 884/1773] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:11 2022] DELETE /identity/v3/projects/f371d8f58dc04952aba7c4d80cf7fcd1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:12.432703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:12.438572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:12.478528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:12.532641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 890/1774] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:12.533584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:12.540363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:12.621574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70af5-61a1-4216-a8cb-832919508f37 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:12.632422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:12.633197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.633514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.633823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.648180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:12.648180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:12.677509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 885/1775] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:12 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:12.679201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:12.681712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:12.731428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda85cb-917e-4867-b62c-c7a0c5934952 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:12.807564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef34063-e943-4d8a-9d30-5334779b3eae admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:12.823279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:12.823981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.825332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.825646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.828171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:12.831586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:12.848149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 886/1776] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:12.849111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:12.849573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:12.852376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:12.876836 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7460d-7ca8-477e-9ad9-b2504f9c0c18 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:12.882590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:12.883572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.883922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.884268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] PATH_INFO: `/v3/users/2198ea5b83b041f9941123d71bd56d48` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.887212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2198ea5b83b041f9941123d71bd56d48)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:12.892934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:12.903079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:12.903751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:12.904030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:12.904302 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:12.915718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:12.960859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:12.962583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:12.980310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 891/1777] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:12.981498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:12.983633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.013882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2198ea5b83b041f9941123d71bd56d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:13.016291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00419f9-5afa-4b38-8b05-f3af82e75d74 service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:13.024768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:13.025463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.025742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.026046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.026751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:13.028670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:13.045754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2198ea5b83b041f9941123d71bd56d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:13.047363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2198ea5b83b041f9941123d71bd56d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:13.048455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2198ea5b83b041f9941123d71bd56d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:13.068031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-93778cab-ba0b-4780-8190-e7791cf61ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2198ea5b83b041f9941123d71bd56d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:13.097838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 887/1778] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:12 2022] DELETE /identity/v3/users/2198ea5b83b041f9941123d71bd56d48 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:13.097838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.098133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.098566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.128187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:13.138032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] MFA Rules not processed for user `375a65c49fe843538ff349221800cf30`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:13.139697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 892/1779] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:12 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:13.141151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:13.143298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.143419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.264610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 888/1780] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:13.265643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:13.270558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.308792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194422f-78f8-4069-b19e-c7a54c2edb75 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:13.323782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:13.325822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.326107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.327055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.327492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:13.333517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:13.389671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 893/1781] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:13 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:13.392786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:13.397900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.459705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362e6d-ff14-4abb-8afd-330c53206675 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:13.478136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f267faa-acc4-44a8-bba4-f44d4a7067f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:13.480790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267faa-acc4-44a8-bba4-f44d4a7067f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.481035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267faa-acc4-44a8-bba4-f44d4a7067f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.481333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267faa-acc4-44a8-bba4-f44d4a7067f3 admin admin] PATH_INFO: `/v3/projects/264bfb3a239242aeaf7d0787dcb2b9b9/users/622a266eb7c84e508993f2f9d18908bf/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.526556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f267faa-acc4-44a8-bba4-f44d4a7067f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264bfb3a239242aeaf7d0787dcb2b9b9, user_id=622a266eb7c84e508993f2f9d18908bf, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:13.529925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f267faa-acc4-44a8-bba4-f44d4a7067f3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:13.532322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2b637-091b-498f-adbc-36d2976d166d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:13.539818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:13.540530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.540848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.541074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.547246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.564778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:13.564978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 889/1782] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:13 2022] PUT /identity/v3/projects/264bfb3a239242aeaf7d0787dcb2b9b9/users/622a266eb7c84e508993f2f9d18908bf/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:13.566667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.567341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.571232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.580796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:13.618460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] MFA Rules not processed for user `5ed9d1c1ec4f419898831b7557b93693`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:13.623053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.626876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 894/1783] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:13.631822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:13.636748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:13.685338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de81aab-2c1d-4df7-abed-4884bb50ffea service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:13.794373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 890/1784] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:13.794373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:13.832639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:13.876052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdafc6-c362-4d2d-b537-5606a01df9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:13.878482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdafc6-c362-4d2d-b537-5606a01df9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.897094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdafc6-c362-4d2d-b537-5606a01df9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.897094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdafc6-c362-4d2d-b537-5606a01df9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:13.900886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdafc6-c362-4d2d-b537-5606a01df9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:13.905533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdafc6-c362-4d2d-b537-5606a01df9c8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:13.992951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 895/1785] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:13 2022] POST /identity/v3/users => generated 294 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:13.995793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:13.997135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:13.998315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.053427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:14.104306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] MFA Rules not processed for user `622a266eb7c84e508993f2f9d18908bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:14.106126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:14.127192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b8e87-35a8-4941-843e-92130645d66e None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:14.146353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:14.147377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:14.147667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:14.147941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.150065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:14.162964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:14.184523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 891/1786] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:14.186922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:14.192168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:14.227426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d308deb-20c8-4a73-b9f7-f0a15f8a6f56 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:14.242798 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:14.243693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:14.243975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:14.244383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] PATH_INFO: `/v3/projects/005e8156cc224201b211a9b6c2dc9d0c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.246487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005e8156cc224201b211a9b6c2dc9d0c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:14.248422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:14.371495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 896/1787] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:14.372559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:14.378548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005e8156cc224201b211a9b6c2dc9d0c', 'request_id': 'req-ca2ba3cf-ae1a-4eac-a08c-57903e791362'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:14.409924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005e8156cc224201b211a9b6c2dc9d0c', 'request_id': 'req-ca2ba3cf-ae1a-4eac-a08c-57903e791362'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:14.412950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26322af7-fab7-4068-9cb0-6fcebe2a3184 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:14.431536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005e8156cc224201b211a9b6c2dc9d0c', 'request_id': 'req-ca2ba3cf-ae1a-4eac-a08c-57903e791362'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:14.471913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] The token cache is being invalidate because project 005e8156cc224201b211a9b6c2dc9d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:14.472283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:14.473806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:14.479898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 892/1788] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:14 2022] DELETE /identity/v3/projects/005e8156cc224201b211a9b6c2dc9d0c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:14.484159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:14.490481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:14.596381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:14.598253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:14.598535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:14.598928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.601469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:14.606087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:14.654037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 897/1789] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:14.655033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:14.666131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:14.699232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df047cb-2c04-4d12-80b7-ea3659782e28 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:14.713860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19f13a-ee28-4db2-88d1-389e56f17c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:14.714675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19f13a-ee28-4db2-88d1-389e56f17c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:14.715082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19f13a-ee28-4db2-88d1-389e56f17c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:14.715945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19f13a-ee28-4db2-88d1-389e56f17c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.716099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19f13a-ee28-4db2-88d1-389e56f17c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:14.720264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19f13a-ee28-4db2-88d1-389e56f17c2c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:14.720408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba3cf-ae1a-4eac-a08c-57903e791362 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:14.735685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:14.736988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:14.737659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:14.738166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] PATH_INFO: `/v3/projects/1a66e287f1664547b6192ab2985c8302/users/3424a7c2a08e4ea0b839277e72f7d01c/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.758723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a66e287f1664547b6192ab2985c8302, user_id=3424a7c2a08e4ea0b839277e72f7d01c, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:14.763126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:14.804656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 898/1790] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:14 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:14.808785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 893/1791] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:14 2022] PUT /identity/v3/projects/1a66e287f1664547b6192ab2985c8302/users/3424a7c2a08e4ea0b839277e72f7d01c/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:14.810441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:14.811299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:14.813729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:14.813884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:14.814688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:14.855917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:14.860813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:14.926965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:14.935506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:14.969392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61318d-023b-4ee7-9eaf-1c9bcf2b8855 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.001605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 899/1792] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:15.002860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.028503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311f5e-2b9a-4c05-adb5-0ea49f9265ba None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.039277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.040195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.040479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.040754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.041586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.043586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.086198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 900/1793] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:15 2022] POST /identity/v3/users => generated 285 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:15.091600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.125922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a1a0c-7b15-4176-a080-35cfcc7957f4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.151148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba578d-fac0-408b-b1c2-dba25c3b373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.152182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba578d-fac0-408b-b1c2-dba25c3b373c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.152467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba578d-fac0-408b-b1c2-dba25c3b373c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.152768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba578d-fac0-408b-b1c2-dba25c3b373c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.153618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba578d-fac0-408b-b1c2-dba25c3b373c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.155319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba578d-fac0-408b-b1c2-dba25c3b373c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.170067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.170067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.170837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.170837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.171208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.176539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.201272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 901/1794] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:15.208210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 894/1795] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:15.209174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.219869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.220339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.220772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.230470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf8f2-a659-48a7-a67a-82038ce55d1e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.245635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.246263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.246544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.246815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.247554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.249173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.269908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 895/1796] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:15.270578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.282298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:15.283628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:15.292370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c706fe-82cd-47c4-82af-6ee5e0300f9d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.299099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 902/1797] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:15.305740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.306711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.307015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.307330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] PATH_INFO: `/v3/projects/1a66e287f1664547b6192ab2985c8302/users/3424a7c2a08e4ea0b839277e72f7d01c/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.315442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a66e287f1664547b6192ab2985c8302, user_id=3424a7c2a08e4ea0b839277e72f7d01c, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.318736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.318846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.341350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 896/1798] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:15 2022] PUT /identity/v3/projects/1a66e287f1664547b6192ab2985c8302/users/3424a7c2a08e4ea0b839277e72f7d01c/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:15.341350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.371540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436635df-ea5f-49d2-bfdc-101d803d54b2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.451120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c21787-b32c-47e8-83ed-0043a70db186 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.462048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.463451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.463735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.464029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] PATH_INFO: `/v3/projects/5f44bdb366da40368201d68847c29c6e/users/822e875f65bd4290bb798e052d5b06d6/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.499382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f44bdb366da40368201d68847c29c6e, user_id=822e875f65bd4290bb798e052d5b06d6, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.502464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.532568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 897/1799] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:15 2022] PUT /identity/v3/projects/5f44bdb366da40368201d68847c29c6e/users/822e875f65bd4290bb798e052d5b06d6/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:15.536432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.560515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cf80-e334-4031-a1ef-1a1c116e6ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.566131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cf80-e334-4031-a1ef-1a1c116e6ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.566435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cf80-e334-4031-a1ef-1a1c116e6ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.566719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cf80-e334-4031-a1ef-1a1c116e6ef8 admin admin] PATH_INFO: `/v3/projects/6c5814342baa43e8b9f1b8e599ae8c14/users/5d702fe59b98405c8309e06eb295d824/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.612351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cf80-e334-4031-a1ef-1a1c116e6ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5814342baa43e8b9f1b8e599ae8c14, user_id=5d702fe59b98405c8309e06eb295d824, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.619237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cf80-e334-4031-a1ef-1a1c116e6ef8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.665268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 903/1800] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:15 2022] PUT /identity/v3/projects/6c5814342baa43e8b9f1b8e599ae8c14/users/5d702fe59b98405c8309e06eb295d824/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:15.687851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fec80-7a52-4663-8413-cba43573c327 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.688209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fec80-7a52-4663-8413-cba43573c327 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.688417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fec80-7a52-4663-8413-cba43573c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.693242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:15.726387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a6a1c-f25b-45b4-a990-f4714c309e22 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.795944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-277fec80-7a52-4663-8413-cba43573c327 None None] MFA Rules not processed for user `3424a7c2a08e4ea0b839277e72f7d01c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:15.800751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-277fec80-7a52-4663-8413-cba43573c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:15.829771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.830906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.831832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.832745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.834227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:15.834844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.837390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.856604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 898/1801] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:15.857792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:15.881922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb150-ea95-45db-b277-7af6be00384f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:15.891249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a2f19-e35e-4e42-b62f-20ac6893a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:15.892130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a2f19-e35e-4e42-b62f-20ac6893a396 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.892538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a2f19-e35e-4e42-b62f-20ac6893a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.892906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a2f19-e35e-4e42-b62f-20ac6893a396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.893965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a2f19-e35e-4e42-b62f-20ac6893a396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:15.896939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a2f19-e35e-4e42-b62f-20ac6893a396 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:15.919329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 899/1802] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:15.921128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:15.921637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:15.922028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:15.969936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] MFA Rules not processed for user `5d702fe59b98405c8309e06eb295d824`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:15.972468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:15.997358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 904/1803] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:16.000313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fec80-7a52-4663-8413-cba43573c327 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.040670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fec80-7a52-4663-8413-cba43573c327 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.064189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.065905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.066940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.068450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.069390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.078018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.086646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:16.090985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 900/1804] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:16.091999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.114503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad3dc2-6426-4d46-a399-672405f6cedc None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.121056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.122052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.122321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.122600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] PATH_INFO: `/v3/projects/5f44bdb366da40368201d68847c29c6e/users/822e875f65bd4290bb798e052d5b06d6/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.124821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f44bdb366da40368201d68847c29c6e, user_id=822e875f65bd4290bb798e052d5b06d6, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.127296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 905/1805] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:15 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:16.128080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.128813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.131234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:16.143015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 901/1806] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:16 2022] PUT /identity/v3/projects/5f44bdb366da40368201d68847c29c6e/users/822e875f65bd4290bb798e052d5b06d6/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:16.153002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.215649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cfb7a-c3cb-4426-8953-ad5c72f978ea admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.224785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:16.242306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db443-515e-47d1-a07e-f230bb55e107 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.248040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.248699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.249014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.249256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.250051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.251961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.278893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.279155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 902/1807] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:16 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:16.279790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.279984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.280088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.280337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.282209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:16.359147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793f92-dde7-476b-b490-a26671aa56e5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.365626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.366224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.366435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.366784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.367119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.367681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70c7d-5741-4c68-9a07-a7073e19a43b service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.367946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.370022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.377525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 906/1808] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:16.378825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.379111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.379533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.410004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] MFA Rules not processed for user `822e875f65bd4290bb798e052d5b06d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:16.411322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:16.414766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 903/1809] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:16 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:16.416968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.431119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb459b-c402-4f32-a3c5-06ac0a2e2784 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.452426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.453148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.453470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.453744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.454457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.459452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.493017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 904/1810] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:16 2022] POST /identity/v3/users => generated 300 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:16.493673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.504760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505a9a-a004-4789-9dfb-b122e559ea39 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.508311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:16.510816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.511676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.511954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.512509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.512966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.514942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.527725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 905/1811] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:16.528402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.538126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646e53f-0848-4cf1-9cb4-91a3e19597da admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.539192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 907/1812] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:16.542936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.543277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.543952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.544231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.544503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.545273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.547412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.556837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df392402-892b-48c8-81f1-3ad3458c6be6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.561367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 906/1813] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:16.561367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.561367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:16.565373 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.565879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.566163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.566430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.567174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.568792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.584520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 908/1814] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:16.584520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.596139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97edf-0c91-468d-8113-b1f49e96c542 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.605376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.606601 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.607034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.608139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] PATH_INFO: `/v3/projects/43c35ccea43841b6b919cc3e6cb66106/users/7460f9dfcaf04feab2382d68f04f3e1d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.629463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c35ccea43841b6b919cc3e6cb66106, user_id=7460f9dfcaf04feab2382d68f04f3e1d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.632160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.642344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5fe2-6374-4c45-a834-0ce92f82e4c3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.658924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 909/1815] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:16 2022] PUT /identity/v3/projects/43c35ccea43841b6b919cc3e6cb66106/users/7460f9dfcaf04feab2382d68f04f3e1d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:16.660274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:16.720368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:16.740444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5a930-16cc-4258-9ae4-0e7c6c4fe3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.742144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a930-16cc-4258-9ae4-0e7c6c4fe3dd service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.743316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a930-16cc-4258-9ae4-0e7c6c4fe3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.743541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a930-16cc-4258-9ae4-0e7c6c4fe3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.825569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8093-0f38-4947-ae0f-d6b5fdb798df admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:16.850807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:16.855327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:16.855979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:16.856601 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] PATH_INFO: `/v3/projects/6a99fce9d5964ed6aeabd93ec34308a9/users/519dcda6e8c8498787ec2f8763a15906/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:16.882359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a99fce9d5964ed6aeabd93ec34308a9, user_id=519dcda6e8c8498787ec2f8763a15906, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:16.886283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:16.916160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 910/1816] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:16 2022] PUT /identity/v3/projects/6a99fce9d5964ed6aeabd93ec34308a9/users/519dcda6e8c8498787ec2f8763a15906/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:16.916160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:17.005306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a930-16cc-4258-9ae4-0e7c6c4fe3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.006834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a930-16cc-4258-9ae4-0e7c6c4fe3dd service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:17.038632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 907/1817] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:17.040175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb624-8b49-49e0-9a4c-be84792702fc None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.040466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb624-8b49-49e0-9a4c-be84792702fc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.049299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb624-8b49-49e0-9a4c-be84792702fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.094965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38746182-23b0-460a-9d22-67f9c04e317b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:17.118640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:17.118833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.119044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.119315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.120177 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.127726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:17.148428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c34bb624-8b49-49e0-9a4c-be84792702fc None None] MFA Rules not processed for user `519dcda6e8c8498787ec2f8763a15906`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:17.150165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c34bb624-8b49-49e0-9a4c-be84792702fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:17.159399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 911/1818] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:17.163806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:17.179260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4adc3-933c-41a7-89ae-ad2bf277e619 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:17.203836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:17.205010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.206239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.206604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] PATH_INFO: `/v3/projects/43c35ccea43841b6b919cc3e6cb66106/users/7460f9dfcaf04feab2382d68f04f3e1d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.212290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c35ccea43841b6b919cc3e6cb66106, user_id=7460f9dfcaf04feab2382d68f04f3e1d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.216792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:17.245558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 912/1819] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:17 2022] PUT /identity/v3/projects/43c35ccea43841b6b919cc3e6cb66106/users/7460f9dfcaf04feab2382d68f04f3e1d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:17.246531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:17.289716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:17.373861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 908/1820] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:17.375531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.375822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.376207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.418706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] MFA Rules not processed for user `7460f9dfcaf04feab2382d68f04f3e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:17.421840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:17.425141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f840f-8102-421a-8cb1-4a0d1de651b9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:17.432497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:17.434743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.435402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.435890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.438676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:17.517248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 909/1821] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:17.520816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:17.541154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:17.546150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.547619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:17.564594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 913/1822] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:17 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:17.567183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:17.580705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e32af-678e-4277-aff2-f9417d294f7c service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:17.585417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:17.586849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.587856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.588561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.603701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.606220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:17.618999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 914/1823] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:17.663393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cc74f-87a4-4eca-8fb5-e6c690047971 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:17.670620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:17.671703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.672001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.672343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.673351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.675808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:17.764613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 910/1824] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:17 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:17.765757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:17.797649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47406508-ed13-47b4-a06d-51721646e5d4 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:17.942873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:17.943756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:17.944104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:17.944442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:17.945209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:17.947506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:18.010541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 915/1825] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:17 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:18.014934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:18.039525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c4af-27bd-4c8f-b1b0-779a8fbcefc1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:18.058624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:18.059729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.060198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.060773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.061920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:18.064653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:18.087633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 911/1826] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:18.093143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:18.134137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de33a00-d252-4676-a45c-0521538bec1d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:18.143457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:18.144606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.145029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.145474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.146543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:18.148950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:18.162099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 916/1827] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:18.166749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:18.181071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c229d1d-8584-4d40-820d-2dcf0986850e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:18.187315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5b9a8-f98a-41c8-bee3-eb5a5c0cca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:18.190583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5b9a8-f98a-41c8-bee3-eb5a5c0cca0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.190885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5b9a8-f98a-41c8-bee3-eb5a5c0cca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.191161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5b9a8-f98a-41c8-bee3-eb5a5c0cca0d admin admin] PATH_INFO: `/v3/projects/7bf406f365054311877ba97014a2a155/users/fbdc5e1c2b404aa48da5c8a8cdc93a4c/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.216925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5b9a8-f98a-41c8-bee3-eb5a5c0cca0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf406f365054311877ba97014a2a155, user_id=fbdc5e1c2b404aa48da5c8a8cdc93a4c, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:18.219981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5b9a8-f98a-41c8-bee3-eb5a5c0cca0d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:18.250283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:18.262462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 912/1828] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:18 2022] PUT /identity/v3/projects/7bf406f365054311877ba97014a2a155/users/fbdc5e1c2b404aa48da5c8a8cdc93a4c/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:18.263637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d755f-64ce-411a-a2b4-beb13f732ce4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.269531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d755f-64ce-411a-a2b4-beb13f732ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.272974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d755f-64ce-411a-a2b4-beb13f732ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.352735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:18.436189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-847d755f-64ce-411a-a2b4-beb13f732ce4 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:18.438543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-847d755f-64ce-411a-a2b4-beb13f732ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:18.479919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49329d4f-157d-499a-aacd-38f92ac60a51 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:18.595556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 913/1829] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:18.596908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.597197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.598857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.635494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:18.637198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.637441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.637737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.687498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] MFA Rules not processed for user `fbdc5e1c2b404aa48da5c8a8cdc93a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:18.688737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:18.756676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:18.793074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:18.795230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:18.826056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 917/1830] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:18.828503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:18.851258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4eb4-d27c-4f3b-8ea6-fccadf1782f8 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:18.861970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 914/1831] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:18.861970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:18.863691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:18.869852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:18.870884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:18.872161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:18.872647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:18.874872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:19.005832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:19.007418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:19.023794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 918/1832] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:19.025074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:19.026170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da354c-86e8-4973-8eba-775ffd8c2746 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:19.033275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:19.034198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:19.034640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:19.035066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:19.071691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:19.080805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:19.098579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:19.116445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 915/1833] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:14:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:14:19.153877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93ba9e-228c-4e73-8d9a-b56146f70d9f service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:19.193155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:19.194055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:19.194407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:19.195074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:19.197194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:19.200157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:19.329644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 919/1834] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:19 2022] POST /identity/v3/projects => generated 379 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:19.336156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:19.363107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee63cd-30d2-4b8b-80e4-4f7592f80a4c service swift] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:19.642852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:19.644538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:19.645038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:19.657163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:19.657163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:19.659617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:19.697394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 916/1835] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:19 2022] POST /identity/v3/users => generated 296 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:19.701751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:19.730657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eee21-7a31-4140-9e34-53799e03bc34 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:19.742590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:19.743990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:19.744712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:19.745318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:19.746404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:19.751050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:19.779967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 920/1836] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:19.786538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:19.801329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826b80b-1b0b-49bf-ae49-bacddb6dbe91 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:19.845928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:19.856051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:19.856328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:19.858935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] PATH_INFO: `/v3/projects/1ebf41fbc0154d6fa78ebc2712237e5e/users/366dd806f7394bb0bcbf79ec713f7fa9/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:19.941753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebf41fbc0154d6fa78ebc2712237e5e, user_id=366dd806f7394bb0bcbf79ec713f7fa9, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:19.941753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:19.952860 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:20.002105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 917/1837] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:19 2022] PUT /identity/v3/projects/1ebf41fbc0154d6fa78ebc2712237e5e/users/366dd806f7394bb0bcbf79ec713f7fa9/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:20.003564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:20.044116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bcce8-38c9-45b5-81b1-959dc9a76b05 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:20.196852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81333e-af2a-41a7-a92d-d230a3706593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:20.211834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81333e-af2a-41a7-a92d-d230a3706593 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:20.214131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81333e-af2a-41a7-a92d-d230a3706593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:20.216036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81333e-af2a-41a7-a92d-d230a3706593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:20.220242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81333e-af2a-41a7-a92d-d230a3706593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:20.223104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81333e-af2a-41a7-a92d-d230a3706593 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:20.275741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 921/1838] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:20.276563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:20.299131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411285bf-e983-46a3-8a9b-6bc24a3bfb57 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:20.316021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:20.319428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:20.319577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:20.320157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] PATH_INFO: `/v3/projects/1ebf41fbc0154d6fa78ebc2712237e5e/users/366dd806f7394bb0bcbf79ec713f7fa9/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:20.328941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebf41fbc0154d6fa78ebc2712237e5e, user_id=366dd806f7394bb0bcbf79ec713f7fa9, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:20.334892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:20.365273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 918/1839] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:20 2022] PUT /identity/v3/projects/1ebf41fbc0154d6fa78ebc2712237e5e/users/366dd806f7394bb0bcbf79ec713f7fa9/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:20.375992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992be4b-81ed-4e24-a347-aa3c4bae8157 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:20.376431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992be4b-81ed-4e24-a347-aa3c4bae8157 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:20.376805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992be4b-81ed-4e24-a347-aa3c4bae8157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:20.494932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1992be4b-81ed-4e24-a347-aa3c4bae8157 None None] MFA Rules not processed for user `366dd806f7394bb0bcbf79ec713f7fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:20.500558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1992be4b-81ed-4e24-a347-aa3c4bae8157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:20.803397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 922/1840] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:20.811545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:21.085336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2430dcd-44bd-4e5d-9733-f45b1f4cf837 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:21.112956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:21.115389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:21.115986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:21.116423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:21.139215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:21.144319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:21.163928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 919/1841] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:21.355708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:21.356048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:21.356266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:21.381624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:21.401943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51281c-ea7d-46dd-b61c-8c1971a7249f service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:21.422053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:21.429281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:21.429633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:21.432041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:21.441390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:21.447223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:21.556971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:21.659364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:21.660960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:21.662074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 923/1842] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Jul 20 09:14:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:21.702136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 920/1843] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:21.786729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:21.788624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:21.809145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdb0ee-2399-4bae-bb79-47804de11d39 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:21.830609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7303971-8f91-46be-9563-6bbf6197c882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:21.833037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7303971-8f91-46be-9563-6bbf6197c882 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:21.833676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7303971-8f91-46be-9563-6bbf6197c882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:21.834880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7303971-8f91-46be-9563-6bbf6197c882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:21.871786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7303971-8f91-46be-9563-6bbf6197c882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:21.873324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7303971-8f91-46be-9563-6bbf6197c882 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:21.892542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 924/1844] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:24.302029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:24.606095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5388-d490-4759-9982-47ae1f3886b9 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:24.622708 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:24.642222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:24.642482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:24.644916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] PATH_INFO: `/v3/users/1e23cac8d8a844fca2d452137ee40602` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:24.647467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e23cac8d8a844fca2d452137ee40602)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:24.652545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:24.761898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:24.845310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e23cac8d8a844fca2d452137ee40602'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:24.899275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e23cac8d8a844fca2d452137ee40602'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:24.902414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e23cac8d8a844fca2d452137ee40602'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:24.906413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e23cac8d8a844fca2d452137ee40602'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:24.927074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e23cac8d8a844fca2d452137ee40602'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:24.979026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 921/1845] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:24 2022] DELETE /identity/v3/users/1e23cac8d8a844fca2d452137ee40602 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:24.979776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:24.980340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:24.980584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:25.073006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:25.078509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:25.312350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 925/1846] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:25.348213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:25.352442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:25.656126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78bfc-2744-4bb4-b6f3-707c99c62852 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:25.670161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35813b-e8ca-433d-ac25-eaa8d0c4e3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:25.671036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35813b-e8ca-433d-ac25-eaa8d0c4e3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:25.671320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35813b-e8ca-433d-ac25-eaa8d0c4e3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:25.671593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35813b-e8ca-433d-ac25-eaa8d0c4e3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:25.694501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35813b-e8ca-433d-ac25-eaa8d0c4e3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:25.696221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35813b-e8ca-433d-ac25-eaa8d0c4e3a7 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:25.747954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 922/1847] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:26.077807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:26.081264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:26.317828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dddcd1-8f94-48e2-921f-bdbbb5f4d769 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:26.322779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:26.323776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:26.324285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:26.324718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:26.327014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:26.423164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:26.460976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:26.490605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 926/1848] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:26.890958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cdfe6-3a63-44e5-b111-3c17dd49c096 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:26.891524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cdfe6-3a63-44e5-b111-3c17dd49c096 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:26.891796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cdfe6-3a63-44e5-b111-3c17dd49c096 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:26.894201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 923/1849] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:14:26.924183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:26.926256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:26.993945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78bf5-6062-43cc-a511-5931c0923a97 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:27.013326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:27.014355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:27.016784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:27.017183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] PATH_INFO: `/v3/users/519dcda6e8c8498787ec2f8763a15906` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:27.023103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=519dcda6e8c8498787ec2f8763a15906)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:27.028885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:27.041848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:27.042141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:27.042421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:27.097854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:27.100894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:27.106596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:27.199493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519dcda6e8c8498787ec2f8763a15906'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:27.253971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519dcda6e8c8498787ec2f8763a15906'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:27.258551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519dcda6e8c8498787ec2f8763a15906'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:27.259671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519dcda6e8c8498787ec2f8763a15906'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:27.282419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bcf66ed6-667a-46c3-8fe2-949051614e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519dcda6e8c8498787ec2f8763a15906'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:27.344665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 927/1850] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:26 2022] DELETE /identity/v3/users/519dcda6e8c8498787ec2f8763a15906 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:27.350329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:27.351225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:27.351611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:27.405503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 924/1851] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:27.416940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:27.419654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:27.527722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 928/1852] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:27.864831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:27.866765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:27.901545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bd50d-c4d1-47b7-a500-76fe5ea884a1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:28.094436 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:28.183995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:28.185685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b89f74-0cc9-400d-a25f-a51aeb00dfce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:28.186546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b89f74-0cc9-400d-a25f-a51aeb00dfce service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:28.186830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b89f74-0cc9-400d-a25f-a51aeb00dfce service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:28.187107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b89f74-0cc9-400d-a25f-a51aeb00dfce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:28.187299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:28.225152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b89f74-0cc9-400d-a25f-a51aeb00dfce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:28.227166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b89f74-0cc9-400d-a25f-a51aeb00dfce service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:28.277403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 925/1853] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:14:28.471541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8aac-f891-4874-bb23-9f95c843d7f0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:28.518506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb67da-6e7e-4de1-bea6-e60f72892e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:28.522180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb67da-6e7e-4de1-bea6-e60f72892e96 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:28.528304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb67da-6e7e-4de1-bea6-e60f72892e96 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:28.533048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb67da-6e7e-4de1-bea6-e60f72892e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:28.563816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb67da-6e7e-4de1-bea6-e60f72892e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:28.581803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb67da-6e7e-4de1-bea6-e60f72892e96 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:28.631697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 929/1854] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:29.268488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4ab7-1fa0-40e9-b9dc-838a3ac92367 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:29.269101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4ab7-1fa0-40e9-b9dc-838a3ac92367 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:29.269101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4ab7-1fa0-40e9-b9dc-838a3ac92367 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:29.270879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 926/1855] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:14:29.297329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:29.297990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:29.297990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:29.331988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:29.334837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:29.372681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 930/1856] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:14:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:29.989844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf4ab7-1fa0-40e9-b9dc-838a3ac92367 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:29.992408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-debf4ab7-1fa0-40e9-b9dc-838a3ac92367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:30.034077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf4ab7-1fa0-40e9-b9dc-838a3ac92367 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:30.055462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:30.057923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:30.058700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:30.059200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] PATH_INFO: `/v3/projects/6a99fce9d5964ed6aeabd93ec34308a9` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:30.062682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a99fce9d5964ed6aeabd93ec34308a9)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:30.071097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:30.268090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a99fce9d5964ed6aeabd93ec34308a9', 'request_id': 'req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.299013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a99fce9d5964ed6aeabd93ec34308a9', 'request_id': 'req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.320228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a99fce9d5964ed6aeabd93ec34308a9', 'request_id': 'req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.355132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] The token cache is being invalidate because project 6a99fce9d5964ed6aeabd93ec34308a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:30.364442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.366334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.373164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 927/1857] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:29 2022] DELETE /identity/v3/projects/6a99fce9d5964ed6aeabd93ec34308a9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:30.377439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:30.405597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bee589-159a-46cb-8038-fdbd6d844f90 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:30.461079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:30.547720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:30.549265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:30.648383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:30.649752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:30.650315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:30.652092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] PATH_INFO: `/v3/users/fbdc5e1c2b404aa48da5c8a8cdc93a4c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:30.654003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdc5e1c2b404aa48da5c8a8cdc93a4c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:30.657757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:30.803949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd826e-ef9a-4eb0-b318-73d0e42354b9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:30.820211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdc5e1c2b404aa48da5c8a8cdc93a4c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.835407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:30.836540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:30.836978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:30.837524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] PATH_INFO: `/v3/users/16e95f2fc4684a3483c8042087256d7b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:30.850173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e95f2fc4684a3483c8042087256d7b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:30.852686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:30.854361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdc5e1c2b404aa48da5c8a8cdc93a4c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.858916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdc5e1c2b404aa48da5c8a8cdc93a4c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.859672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdc5e1c2b404aa48da5c8a8cdc93a4c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.878338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdc5e1c2b404aa48da5c8a8cdc93a4c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:30.918481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 931/1858] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:30 2022] DELETE /identity/v3/users/fbdc5e1c2b404aa48da5c8a8cdc93a4c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:30.919987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:30.922467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:30.968171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e95f2fc4684a3483c8042087256d7b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.012626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:31.016080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e95f2fc4684a3483c8042087256d7b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.033774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e95f2fc4684a3483c8042087256d7b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.042460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e95f2fc4684a3483c8042087256d7b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.075616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e95f2fc4684a3483c8042087256d7b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.119786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cdbfa-475b-4d4a-8efa-9c3d01af456f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:31.121290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 928/1859] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:30 2022] DELETE /identity/v3/users/16e95f2fc4684a3483c8042087256d7b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:31.122620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:31.125759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:31.197363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:31.229264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:31.230284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:31.230624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:31.230902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] PATH_INFO: `/v3/projects/28675e89112d46ba81acb00bc127e090` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:31.233259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28675e89112d46ba81acb00bc127e090)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:31.246800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:31.262985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adaf69-6e74-45b2-a004-8e7c324d4b19 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:31.277433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:31.278991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:31.279973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:31.280270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:31.283856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:31.319245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:31.321521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625d720-2eef-4c54-9773-fe0b88442887 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:31.337444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 929/1860] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:31.341016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:31.341542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:31.342070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:31.353880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28675e89112d46ba81acb00bc127e090', 'request_id': 'req-d957d656-8818-4d70-9cd4-5e9d0534375f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.363445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28675e89112d46ba81acb00bc127e090', 'request_id': 'req-d957d656-8818-4d70-9cd4-5e9d0534375f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.372739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28675e89112d46ba81acb00bc127e090', 'request_id': 'req-d957d656-8818-4d70-9cd4-5e9d0534375f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.390134 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:31.391635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:31.391991 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] The token cache is being invalidate because project 28675e89112d46ba81acb00bc127e090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:31.392473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.393090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.397278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 932/1861] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:30 2022] DELETE /identity/v3/projects/28675e89112d46ba81acb00bc127e090 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:31.399781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:31.402369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:31.594318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d656-8818-4d70-9cd4-5e9d0534375f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:31.600642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:31.602253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:31.602990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:31.603682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] PATH_INFO: `/v3/users/3424a7c2a08e4ea0b839277e72f7d01c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:31.605095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 930/1862] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:31.605727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3424a7c2a08e4ea0b839277e72f7d01c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:31.608944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:31.666719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:31.668563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:31.698810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3424a7c2a08e4ea0b839277e72f7d01c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.747501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3424a7c2a08e4ea0b839277e72f7d01c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.751957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3424a7c2a08e4ea0b839277e72f7d01c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.753445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3424a7c2a08e4ea0b839277e72f7d01c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.777835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3424a7c2a08e4ea0b839277e72f7d01c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:31.781992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:31.811582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 933/1863] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:31 2022] DELETE /identity/v3/users/3424a7c2a08e4ea0b839277e72f7d01c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:31.821411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaeb29-eacf-49eb-8797-ed87a0a7d52b None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:31.883729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:31.968775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:31.970036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:31.970036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:31.970821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:31.973545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:32.111269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:32.113667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:32.129602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 931/1864] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:14:33.067726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:33.069309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:33.083785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cf3a6-434c-4be2-962e-b0d9507c6d95 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:33.089669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:33.090647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:33.090954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:33.091135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] PATH_INFO: `/v3/projects/7bf406f365054311877ba97014a2a155` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:33.100666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf406f365054311877ba97014a2a155)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:33.100666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:33.188278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf406f365054311877ba97014a2a155', 'request_id': 'req-2eca12d2-f574-4533-8aa7-e9543b5445ac'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.195732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf406f365054311877ba97014a2a155', 'request_id': 'req-2eca12d2-f574-4533-8aa7-e9543b5445ac'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.203675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf406f365054311877ba97014a2a155', 'request_id': 'req-2eca12d2-f574-4533-8aa7-e9543b5445ac'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.223835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] The token cache is being invalidate because project 7bf406f365054311877ba97014a2a155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:33.224785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.225892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.227994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 934/1865] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:33 2022] DELETE /identity/v3/projects/7bf406f365054311877ba97014a2a155 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:33.232489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:33.247485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad91f2-4f93-4199-8bdf-ca5abb511af7 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:33.353941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:33.355837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:33.424005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:33.425470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:33.426040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:33.426488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] PATH_INFO: `/v3/users/366dd806f7394bb0bcbf79ec713f7fa9` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:33.429154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=366dd806f7394bb0bcbf79ec713f7fa9)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:33.432052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:33.525378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca12d2-f574-4533-8aa7-e9543b5445ac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:33.533221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366dd806f7394bb0bcbf79ec713f7fa9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.533575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:33.534501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:33.534785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:33.535063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] PATH_INFO: `/v3/projects/1a66e287f1664547b6192ab2985c8302` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:33.537907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a66e287f1664547b6192ab2985c8302)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:33.546452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:33.567818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366dd806f7394bb0bcbf79ec713f7fa9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.572010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366dd806f7394bb0bcbf79ec713f7fa9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.574878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366dd806f7394bb0bcbf79ec713f7fa9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.594412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366dd806f7394bb0bcbf79ec713f7fa9'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.598770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:33.630944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 932/1866] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:33 2022] DELETE /identity/v3/users/366dd806f7394bb0bcbf79ec713f7fa9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:33.632362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:33.634223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:33.657621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a66e287f1664547b6192ab2985c8302', 'request_id': 'req-5762ed23-ce3c-4151-8a77-b2bb21cfe895'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.670178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a66e287f1664547b6192ab2985c8302', 'request_id': 'req-5762ed23-ce3c-4151-8a77-b2bb21cfe895'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.689934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a66e287f1664547b6192ab2985c8302', 'request_id': 'req-5762ed23-ce3c-4151-8a77-b2bb21cfe895'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.719691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] The token cache is being invalidate because project 1a66e287f1664547b6192ab2985c8302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:33.720635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.720635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5762ed23-ce3c-4151-8a77-b2bb21cfe895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.722393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 935/1867] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:33 2022] DELETE /identity/v3/projects/1a66e287f1664547b6192ab2985c8302 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:33.727506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4a89-2b72-4967-bd41-30d13a4a1f79 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:33.727837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4a89-2b72-4967-bd41-30d13a4a1f79 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:33.728126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4a89-2b72-4967-bd41-30d13a4a1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:33.748255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:INSERT=3,keystone:DELETE=15,keystone:SELECT=82 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:33.783776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a8f4a89-2b72-4967-bd41-30d13a4a1f79 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:33.784022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a8f4a89-2b72-4967-bd41-30d13a4a1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:33.790732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39934199-34db-47ad-99ae-a447b9a1f6ea admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:33.882023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:33.884980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:33.885447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:33.887317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] PATH_INFO: `/v3/projects/36551652b7dd4ee1b022b3a0bb3914b6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:33.888908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36551652b7dd4ee1b022b3a0bb3914b6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:33.893348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:33.946385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 936/1868] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:33.954478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:33.954679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:33.954977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:33.958161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36551652b7dd4ee1b022b3a0bb3914b6', 'request_id': 'req-8f2a12fc-b887-4904-ab1a-85b67a920287'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.964735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36551652b7dd4ee1b022b3a0bb3914b6', 'request_id': 'req-8f2a12fc-b887-4904-ab1a-85b67a920287'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.971468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36551652b7dd4ee1b022b3a0bb3914b6', 'request_id': 'req-8f2a12fc-b887-4904-ab1a-85b67a920287'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.976182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:33.977497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:33.987092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] The token cache is being invalidate because project 36551652b7dd4ee1b022b3a0bb3914b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:33.987518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.988279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:33.990056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 933/1869] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:33 2022] DELETE /identity/v3/projects/36551652b7dd4ee1b022b3a0bb3914b6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:33.995201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:33.998061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.034967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:34.059049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 937/1870] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:34.063105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.075483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef58a-86c1-4fad-9e79-b389dbf3f5e4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.080728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.081728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.082080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.082428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.083297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:34.083685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.085574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.086696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a12fc-b887-4904-ab1a-85b67a920287 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.092910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.094412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.094412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.094694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] PATH_INFO: `/v3/users/5d702fe59b98405c8309e06eb295d824` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.096304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d702fe59b98405c8309e06eb295d824)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.098683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.099668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 938/1871] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:14:34.113740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.144023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ea935-48e1-4133-8a35-f322fe3bb6d1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.157558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.158261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.158571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.159556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.160862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.163379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.213263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 939/1872] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:34.217472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.220135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d702fe59b98405c8309e06eb295d824'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.236243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d702fe59b98405c8309e06eb295d824'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.237086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d702fe59b98405c8309e06eb295d824'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.237862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d702fe59b98405c8309e06eb295d824'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.246766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d702fe59b98405c8309e06eb295d824'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.267991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 934/1873] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:33 2022] DELETE /identity/v3/users/5d702fe59b98405c8309e06eb295d824 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:34.314209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b850-29ef-4d5c-be63-08d6638b9ed4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.334676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:34.406718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.408713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.421784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.422793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.422793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.423170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.423992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.426259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.456301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 940/1874] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:34.457123 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.458927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.472548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020083-7bbb-4dc8-bd5b-f8c1dc6560a8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.485620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.486577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.488555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.489066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.490721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.493037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.510747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 941/1875] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:34.514814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.520627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d6ff-dc5e-4fe4-92b7-c3184cb4667f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.527530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.528778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.529200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.529675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] PATH_INFO: `/v3/projects/1ebf41fbc0154d6fa78ebc2712237e5e` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.532752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebf41fbc0154d6fa78ebc2712237e5e)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.535374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.539082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31bbd-b111-467b-bfc0-cefec603e0ba admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.548745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.549621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.549978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.550357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.551184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.552905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.570773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 942/1876] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:14:34.572098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.585875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34976e-8e68-4f58-86b4-b3bb5e49f22e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.609322 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebf41fbc0154d6fa78ebc2712237e5e', 'request_id': 'req-a841f7d0-e511-4603-a437-49aca2882e6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.610838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:34.622625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebf41fbc0154d6fa78ebc2712237e5e', 'request_id': 'req-a841f7d0-e511-4603-a437-49aca2882e6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.633847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebf41fbc0154d6fa78ebc2712237e5e', 'request_id': 'req-a841f7d0-e511-4603-a437-49aca2882e6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.654766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] The token cache is being invalidate because project 1ebf41fbc0154d6fa78ebc2712237e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:34.655060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.655720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a841f7d0-e511-4603-a437-49aca2882e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.657638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 935/1877] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:34 2022] DELETE /identity/v3/projects/1ebf41fbc0154d6fa78ebc2712237e5e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:34.663704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989dad8-0ae4-4947-ab5e-c7034fe7bc20 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.664336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989dad8-0ae4-4947-ab5e-c7034fe7bc20 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.664802 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989dad8-0ae4-4947-ab5e-c7034fe7bc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.670276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa9517-9e5a-4b76-b926-c5f45d766548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.671193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa9517-9e5a-4b76-b926-c5f45d766548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.671795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa9517-9e5a-4b76-b926-c5f45d766548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.671795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa9517-9e5a-4b76-b926-c5f45d766548 admin admin] PATH_INFO: `/v3/projects/1a2a31cf9409443186c0c98cbc06c1db/users/4f076d4b9fa44497a31b0817ae0d3f13/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.690578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b989dad8-0ae4-4947-ab5e-c7034fe7bc20 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:34.691102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa9517-9e5a-4b76-b926-c5f45d766548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2a31cf9409443186c0c98cbc06c1db, user_id=4f076d4b9fa44497a31b0817ae0d3f13, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.692098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b989dad8-0ae4-4947-ab5e-c7034fe7bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.694923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa9517-9e5a-4b76-b926-c5f45d766548 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.700615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 936/1878] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:34.711808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.712068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.712349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.717411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 943/1879] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:34 2022] PUT /identity/v3/projects/1a2a31cf9409443186c0c98cbc06c1db/users/4f076d4b9fa44497a31b0817ae0d3f13/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:34.729475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.732594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.732870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.735313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:34.736661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.762048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] MFA Rules not processed for user `4f076d4b9fa44497a31b0817ae0d3f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:34.763294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.800641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 937/1880] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:34.801703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.802997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.816399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f790e64-d4ac-4b8a-9319-8d4250b2f1b4 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.821275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.822263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.822607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.822873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] PATH_INFO: `/v3/projects/6c5814342baa43e8b9f1b8e599ae8c14` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.824243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5814342baa43e8b9f1b8e599ae8c14)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.826020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.833295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:34.843721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 944/1881] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:34.844652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.856758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf371a4-f46d-46d0-bb2c-28064b9151a9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.863296 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.864049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.865154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.865154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.865938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:34.866277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.868137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:34.882113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 945/1882] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:34.886671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.888552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.888949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5814342baa43e8b9f1b8e599ae8c14', 'request_id': 'req-49b38e91-ec37-4428-bb74-b83975ba3e47'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.898867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5814342baa43e8b9f1b8e599ae8c14', 'request_id': 'req-49b38e91-ec37-4428-bb74-b83975ba3e47'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.904815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43c35b-f753-4edb-aafe-e1b3f9729a9a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:34.905681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5814342baa43e8b9f1b8e599ae8c14', 'request_id': 'req-49b38e91-ec37-4428-bb74-b83975ba3e47'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.921114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] The token cache is being invalidate because project 6c5814342baa43e8b9f1b8e599ae8c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:34.921587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.922370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:34.924486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 938/1883] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:34 2022] DELETE /identity/v3/projects/6c5814342baa43e8b9f1b8e599ae8c14 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:34.925334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:34.926728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:34.969203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:34.969953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:34.970226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:34.970564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:34.971577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:34.973684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.000755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:35.006654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38e91-ec37-4428-bb74-b83975ba3e47 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.018679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 946/1884] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:35.018679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.019940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.021635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.022051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.022468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.023920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.027463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.032936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.066958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 939/1885] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:35.068620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.070885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.120999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b8f63-170f-44b7-b324-98b0d7a8dadf admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.156376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f12ef-0162-437d-9e68-e250ae388ff4 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.163002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.163720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.164213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.164623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.165615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.168846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.196956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 940/1886] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:35 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:35.198309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.214152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382995b-4c75-46dd-9169-5f013b42195b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.219693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.219901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.220196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.220527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.221181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.223516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.224167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.225339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.225714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.226076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] PATH_INFO: `/v3/users/7460f9dfcaf04feab2382d68f04f3e1d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.227452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7460f9dfcaf04feab2382d68f04f3e1d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.229790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.260901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:35.268058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 941/1887] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:35 2022] POST /identity/v3/users => generated 287 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:35.268058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.277698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d553-3dc6-4e84-af63-9c2aae1d8500 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.282745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.283500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.283842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.284178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.285004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.286793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.298808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 942/1888] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:35.299626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.310923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732e321-723e-40bf-ae0d-028512e22382 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.314088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7460f9dfcaf04feab2382d68f04f3e1d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:35.316005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.316959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.316959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.317257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.318025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.319623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.332261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7460f9dfcaf04feab2382d68f04f3e1d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:35.333006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7460f9dfcaf04feab2382d68f04f3e1d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:35.333756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7460f9dfcaf04feab2382d68f04f3e1d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:35.337262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 943/1889] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:35.337262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.338320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.343828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7460f9dfcaf04feab2382d68f04f3e1d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:35.351359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bdd9b-90cc-4dd5-9b26-8063e1c013ff admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.356538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.357973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.358251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.358527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] PATH_INFO: `/v3/projects/02e12dfc2ffd48aeb554f28add64d17f/users/8422f13dcaf54b19b0c9621830dd4886/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.358763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 947/1890] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:35 2022] DELETE /identity/v3/users/7460f9dfcaf04feab2382d68f04f3e1d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:35.361873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.361873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.375205 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e12dfc2ffd48aeb554f28add64d17f, user_id=8422f13dcaf54b19b0c9621830dd4886, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.377873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.397203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 944/1891] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:35 2022] PUT /identity/v3/projects/02e12dfc2ffd48aeb554f28add64d17f/users/8422f13dcaf54b19b0c9621830dd4886/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:35.402258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.464206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95e48-8d76-49c4-b9dc-214a60f0dacb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.505933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59321a7-2811-43f3-92ee-fc0ad99dc100 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.513485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.514623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.515310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.515716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.516684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.518906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.530119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.531072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.531452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.531849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.532999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.534773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.540548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 945/1892] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:35.545103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.550506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:35.556341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 948/1893] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:35.557968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1465c-ed3f-43f4-9677-10e33627145d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.560764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.565841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9d55-6812-4a71-9218-eb2000ade703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.566359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9d55-6812-4a71-9218-eb2000ade703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.566687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9d55-6812-4a71-9218-eb2000ade703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.566957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9d55-6812-4a71-9218-eb2000ade703 admin admin] PATH_INFO: `/v3/projects/02e12dfc2ffd48aeb554f28add64d17f/users/8422f13dcaf54b19b0c9621830dd4886/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.569987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9d55-6812-4a71-9218-eb2000ade703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e12dfc2ffd48aeb554f28add64d17f, user_id=8422f13dcaf54b19b0c9621830dd4886, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.573265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9d55-6812-4a71-9218-eb2000ade703 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.582423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eff360-6e7d-499a-a8c2-5f82afafdbc9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.589256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 946/1894] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:35 2022] PUT /identity/v3/projects/02e12dfc2ffd48aeb554f28add64d17f/users/8422f13dcaf54b19b0c9621830dd4886/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:35.600144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.600553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.600925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.635162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:35.644108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] MFA Rules not processed for user `8422f13dcaf54b19b0c9621830dd4886`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:35.645548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.659696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f6161-4c2e-4e3e-a013-e579e6e62a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.661074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f6161-4c2e-4e3e-a013-e579e6e62a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.661074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f6161-4c2e-4e3e-a013-e579e6e62a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.661345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f6161-4c2e-4e3e-a013-e579e6e62a45 admin admin] PATH_INFO: `/v3/projects/7d3510effdac4105bdbe85d6e6635575/users/958873085c76404bb8c68efcd6516281/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.680112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f6161-4c2e-4e3e-a013-e579e6e62a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3510effdac4105bdbe85d6e6635575, user_id=958873085c76404bb8c68efcd6516281, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.683830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f6161-4c2e-4e3e-a013-e579e6e62a45 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.700024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 949/1895] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:35 2022] PUT /identity/v3/projects/7d3510effdac4105bdbe85d6e6635575/users/958873085c76404bb8c68efcd6516281/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:35.705356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.705729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.706148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.727226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:35.728659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.734877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 947/1896] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:35.746118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.747959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.810238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 950/1897] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:35.812565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af64b9-d9a6-4416-b26e-6bc6809f8c65 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.820356 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.822080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.885674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb40690-9ebb-4560-8cab-078e325a6568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.886450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb40690-9ebb-4560-8cab-078e325a6568 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.886734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb40690-9ebb-4560-8cab-078e325a6568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.887001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb40690-9ebb-4560-8cab-078e325a6568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.893370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a8d7f-a6c9-4a4b-9a83-f8901ffe015b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.896943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.897650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.897934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.898208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.907416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.908868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.919149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 951/1898] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:35.920158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:35.922329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:35.934069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:35.943332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f210a9d-6a03-420e-be22-b5faad487ea1 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:35.949580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:35.950625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:35.950906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:35.951320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] PATH_INFO: `/v3/projects/43c35ccea43841b6b919cc3e6cb66106` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:35.952754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c35ccea43841b6b919cc3e6cb66106)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.955157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.957955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb40690-9ebb-4560-8cab-078e325a6568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:35.959472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb40690-9ebb-4560-8cab-078e325a6568 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:35.971482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 948/1899] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:36.021716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c35ccea43841b6b919cc3e6cb66106', 'request_id': 'req-daed5b4c-6eef-417a-8877-02812152485c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.041679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c35ccea43841b6b919cc3e6cb66106', 'request_id': 'req-daed5b4c-6eef-417a-8877-02812152485c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.044472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:36.051630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c35ccea43841b6b919cc3e6cb66106', 'request_id': 'req-daed5b4c-6eef-417a-8877-02812152485c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.075799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] The token cache is being invalidate because project 43c35ccea43841b6b919cc3e6cb66106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:36.076089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.077046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.080307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 952/1900] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:35 2022] DELETE /identity/v3/projects/43c35ccea43841b6b919cc3e6cb66106 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:36.088296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e9f6-6ede-4c81-8452-3863811aeab4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.089445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e9f6-6ede-4c81-8452-3863811aeab4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.089909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e9f6-6ede-4c81-8452-3863811aeab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.124599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8f22e9f6-6ede-4c81-8452-3863811aeab4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:36.126689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8f22e9f6-6ede-4c81-8452-3863811aeab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:36.138530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.139992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:36.225077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 949/1901] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:36.226636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.226890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.227460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.245635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5b4c-6eef-417a-8877-02812152485c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.253717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:36.256006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.256557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:36.258568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.271273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.273197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] PATH_INFO: `/v3/users/4f076d4b9fa44497a31b0817ae0d3f13` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.276195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 950/1902] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:36.277208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f076d4b9fa44497a31b0817ae0d3f13)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.277367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.283315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.288319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48a53-58ba-4775-b8bb-b58e446201ec None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.297812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.298524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.298805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.299077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.302612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:36.302936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.309171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.343443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 951/1903] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:36.348487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.379401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f56cc1-48fa-442a-be8c-0729108ca664 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.386852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.387577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.387859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.388398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.389114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.391130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.421029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f076d4b9fa44497a31b0817ae0d3f13'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.442348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 952/1904] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:36 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:36.443309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.490270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f076d4b9fa44497a31b0817ae0d3f13'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.496149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f076d4b9fa44497a31b0817ae0d3f13'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.506679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f076d4b9fa44497a31b0817ae0d3f13'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.532337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c3fb6bcd-7a51-40b5-b0e3-9e58565ef313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f076d4b9fa44497a31b0817ae0d3f13'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:36.547331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d13288-8a54-45d0-92cb-a359bb6aa9b5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.554395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.555530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.555530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.556012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.556990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.560305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.570390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 953/1905] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:36 2022] DELETE /identity/v3/users/4f076d4b9fa44497a31b0817ae0d3f13 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:36.571933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.573023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.573337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.602912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 953/1906] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:36 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:36.608764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.611703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:36.613017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:36.614989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:36.631862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96fa24-4cfc-4918-be40-7b8f3791e053 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.685939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:36.755195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.756032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.756189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 954/1907] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:36.756526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.756891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.758742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.761662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.779473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 954/1908] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:36.785040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.803608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9e1fc-288a-49e8-bd67-7bdb2b368c40 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.809831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.810530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.810823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.811074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.811177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.811923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.813692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:36.824406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.827072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:36.843230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 955/1909] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:36.844257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:36.864151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682cf0-fdb1-497f-a108-075407957d36 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.869844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b11c-d848-43fc-bbdd-05962cf2c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:36.870868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b11c-d848-43fc-bbdd-05962cf2c18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.871147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b11c-d848-43fc-bbdd-05962cf2c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.871418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b11c-d848-43fc-bbdd-05962cf2c18f admin admin] PATH_INFO: `/v3/projects/dab60761070944eab80ec057f535cb38/users/9d1c305e2487446aa074fd2643b43e25/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.888260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b11c-d848-43fc-bbdd-05962cf2c18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab60761070944eab80ec057f535cb38, user_id=9d1c305e2487446aa074fd2643b43e25, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:36.890928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b11c-d848-43fc-bbdd-05962cf2c18f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:36.936261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 956/1910] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:36 2022] PUT /identity/v3/projects/dab60761070944eab80ec057f535cb38/users/9d1c305e2487446aa074fd2643b43e25/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:36.938149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:36.938472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:36.938714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:36.993718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badc63-b825-4407-a540-73590de8d6ba admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:36.998363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] MFA Rules not processed for user `9d1c305e2487446aa074fd2643b43e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:37.002891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:37.115213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.115933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.116213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.116652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.126375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 957/1911] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:37.131803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:37.237103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433872d-87d2-47f2-bc7c-23a37bd14462 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:37.242604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.244679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.244978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.245844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.246844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.247286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.248142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.250934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.260178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 955/1912] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:37.290356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:37.297501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 958/1913] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:37 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:37.329819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc1f49-3e50-400d-a901-58a513e7e8e9 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:37.368709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:37.412784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.413985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.414299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.414611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.416357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.418556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.446016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 956/1914] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:37 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:37.447395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:37.469758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519afce4-5095-4056-a7f9-13fb48cd1ccb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:37.475682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.476353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.476637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.476962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.478161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.480013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.509273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 959/1915] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:37.514242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:37.527347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7fc6-ebf6-4240-b119-0a9a6e618d0d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:37.533897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.534828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.535741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.535882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] PATH_INFO: `/v3/projects/9fa3cb403a2947d0af59e75925c46491/users/a6cb47ab95f8460c9a9e2b7006fc1887/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.576108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa3cb403a2947d0af59e75925c46491, user_id=a6cb47ab95f8460c9a9e2b7006fc1887, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.582790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.619564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:37.623627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 957/1916] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:37 2022] PUT /identity/v3/projects/9fa3cb403a2947d0af59e75925c46491/users/a6cb47ab95f8460c9a9e2b7006fc1887/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:37.638347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cc80-4857-461f-9dac-deee241ecdf7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:37.701693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:37.737243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c3abd-2ab5-49e9-9f71-755847d6f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.738274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c3abd-2ab5-49e9-9f71-755847d6f574 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.738756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c3abd-2ab5-49e9-9f71-755847d6f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.739181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c3abd-2ab5-49e9-9f71-755847d6f574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.741499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c3abd-2ab5-49e9-9f71-755847d6f574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.743386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c3abd-2ab5-49e9-9f71-755847d6f574 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.760796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 960/1917] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:14:37.767015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:37.785082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b19b52-818b-427b-ad6a-bd8729598fb6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:37.793854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f65cb-3c64-4133-8666-eef1e730ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:37.795197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f65cb-3c64-4133-8666-eef1e730ae14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.795567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f65cb-3c64-4133-8666-eef1e730ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.796600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f65cb-3c64-4133-8666-eef1e730ae14 admin admin] PATH_INFO: `/v3/projects/9fa3cb403a2947d0af59e75925c46491/users/a6cb47ab95f8460c9a9e2b7006fc1887/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.799925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f65cb-3c64-4133-8666-eef1e730ae14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa3cb403a2947d0af59e75925c46491, user_id=a6cb47ab95f8460c9a9e2b7006fc1887, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:37.803478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f65cb-3c64-4133-8666-eef1e730ae14 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:37.834637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 958/1918] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:37 2022] PUT /identity/v3/projects/9fa3cb403a2947d0af59e75925c46491/users/a6cb47ab95f8460c9a9e2b7006fc1887/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:37.835046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.835343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.835621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.842328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:37.842686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:37.842967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:37.875746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] MFA Rules not processed for user `958873085c76404bb8c68efcd6516281`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:37.877156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:37.879172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] MFA Rules not processed for user `a6cb47ab95f8460c9a9e2b7006fc1887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:37.881059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:37.993272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 961/1919] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:38.001429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 959/1920] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:38.004697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.005399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.006672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:38.006799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:38.144118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86303e15-2ed9-42c8-8df7-6e895f2351dd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.156186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.157083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.158157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.158543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.161167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3568d4-7d96-400c-8b2f-b4c9c1774d62 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.171324 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.173363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.177104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.178588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.179038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.179465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.180339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.182449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.188269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 960/1921] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:14:38.262627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 962/1922] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:38 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:38.267638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.280990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84407905-16ee-4e7b-bdd9-6a6b7755b1fe service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.304761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:38.458691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.461353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.462050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.462328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.463009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.463721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.465865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.516057 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 961/1923] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:38 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:38.518636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.541126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e52d3f-c33b-4f47-bfae-aa7c36d4fbd9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.553537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:38.568573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.569916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.570194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.570476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.571221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.573410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.573926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ea5e4-0744-4787-a2fc-dce5a6bdd55f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.579467 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.580870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.581544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.582007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.632718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 962/1924] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:38.633871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.641686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:38.665356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422624e-899d-4331-a371-9e77640100c6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.675467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.677078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.677363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.678514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] PATH_INFO: `/v3/projects/1a2a31cf9409443186c0c98cbc06c1db` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.680334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2a31cf9409443186c0c98cbc06c1db)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.683995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.693962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.698413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.718226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 963/1925] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:38.719433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.735808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7ad7-1fcd-450b-aca3-9185a357b9d1 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:38.742454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:38.743716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:38.744277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:38.745154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] PATH_INFO: `/v3/projects/07a0ae3bfacc4862ae69d11a849e6c68/users/7ce071c53d354b4faf8bcc8b535eef9b/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:38.794473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a0ae3bfacc4862ae69d11a849e6c68, user_id=7ce071c53d354b4faf8bcc8b535eef9b, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:38.797411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:38.828317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 964/1926] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:38 2022] PUT /identity/v3/projects/07a0ae3bfacc4862ae69d11a849e6c68/users/7ce071c53d354b4faf8bcc8b535eef9b/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:38.829121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.837145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:38.865743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2a31cf9409443186c0c98cbc06c1db', 'request_id': 'req-3313f5bd-0978-4b98-ac65-d1772a8c4b15'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:38.872723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2a31cf9409443186c0c98cbc06c1db', 'request_id': 'req-3313f5bd-0978-4b98-ac65-d1772a8c4b15'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:38.881276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2a31cf9409443186c0c98cbc06c1db', 'request_id': 'req-3313f5bd-0978-4b98-ac65-d1772a8c4b15'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:38.906518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] The token cache is being invalidate because project 1a2a31cf9409443186c0c98cbc06c1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:38.906855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:38.916568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:38.918774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 963/1927] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:38 2022] DELETE /identity/v3/projects/1a2a31cf9409443186c0c98cbc06c1db => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:38.919497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:38.921582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:38.954864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4244c-1994-49ae-90d1-40686ed34515 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.034781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313f5bd-0978-4b98-ac65-d1772a8c4b15 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.040751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5af28e-8529-4487-b52f-919171362b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.042214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5af28e-8529-4487-b52f-919171362b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.042594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5af28e-8529-4487-b52f-919171362b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.042875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5af28e-8529-4487-b52f-919171362b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.044218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5af28e-8529-4487-b52f-919171362b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:39.046491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5af28e-8529-4487-b52f-919171362b55 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:39.048971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.050020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.050519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.050903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] PATH_INFO: `/v3/users/622a266eb7c84e508993f2f9d18908bf` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.052398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622a266eb7c84e508993f2f9d18908bf)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:39.054668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:39.064032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 964/1928] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:39.065761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9582874-7d72-4814-b509-25bd12bd43a0 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.066055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9582874-7d72-4814-b509-25bd12bd43a0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.066333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9582874-7d72-4814-b509-25bd12bd43a0 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.068004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 965/1929] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:14:39.068634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9582874-7d72-4814-b509-25bd12bd43a0 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:39.071330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d9582874-7d72-4814-b509-25bd12bd43a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.091626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9582874-7d72-4814-b509-25bd12bd43a0 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.098195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.099627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.100162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.100362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:39.100472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] PATH_INFO: `/v3/users/8422f13dcaf54b19b0c9621830dd4886` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.101844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8422f13dcaf54b19b0c9621830dd4886)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:39.105298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:39.116079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:39.145895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622a266eb7c84e508993f2f9d18908bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.162131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622a266eb7c84e508993f2f9d18908bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.163078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622a266eb7c84e508993f2f9d18908bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.164055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622a266eb7c84e508993f2f9d18908bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.174082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622a266eb7c84e508993f2f9d18908bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.194472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8422f13dcaf54b19b0c9621830dd4886'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.201342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 965/1930] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:38 2022] DELETE /identity/v3/users/622a266eb7c84e508993f2f9d18908bf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:39.203172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:39.205144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.224852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8422f13dcaf54b19b0c9621830dd4886'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.226132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8422f13dcaf54b19b0c9621830dd4886'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.226890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8422f13dcaf54b19b0c9621830dd4886'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.236328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-95ea94a2-08e6-410e-9e45-02707b25b6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8422f13dcaf54b19b0c9621830dd4886'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.273593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 966/1931] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:39 2022] DELETE /identity/v3/users/8422f13dcaf54b19b0c9621830dd4886 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:39.279924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c01e9-39b2-4bde-97f2-380070f21a3e None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.279924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c01e9-39b2-4bde-97f2-380070f21a3e None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.293867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c01e9-39b2-4bde-97f2-380070f21a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.305722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6dc08-64ae-4021-a8cd-a7ede8ecf2c2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.357441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-768c01e9-39b2-4bde-97f2-380070f21a3e None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:39.358689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-768c01e9-39b2-4bde-97f2-380070f21a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.402860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.404942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.405677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.406272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] PATH_INFO: `/v3/projects/07a0ae3bfacc4862ae69d11a849e6c68/users/7ce071c53d354b4faf8bcc8b535eef9b/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.410019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a0ae3bfacc4862ae69d11a849e6c68, user_id=7ce071c53d354b4faf8bcc8b535eef9b, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:39.413998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:39.435803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 966/1932] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:39 2022] PUT /identity/v3/projects/07a0ae3bfacc4862ae69d11a849e6c68/users/7ce071c53d354b4faf8bcc8b535eef9b/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:39.436877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:39.440166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.464371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 967/1933] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:39.472004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.472294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.472571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.516840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:39.519594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.530317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:39.568506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f33fc7-bb3e-4a40-ab08-37e91b50851e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.574828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.576064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.576185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.576461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] PATH_INFO: `/v3/users/9d1c305e2487446aa074fd2643b43e25` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.577792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1c305e2487446aa074fd2643b43e25)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:39.579851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:39.683294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 968/1934] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:39.684227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:39.687365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.702024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1c305e2487446aa074fd2643b43e25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.720938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1c305e2487446aa074fd2643b43e25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.721831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1c305e2487446aa074fd2643b43e25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.722533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1c305e2487446aa074fd2643b43e25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.732434 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1c305e2487446aa074fd2643b43e25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:39.747298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:39.757677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 967/1935] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:39 2022] DELETE /identity/v3/users/9d1c305e2487446aa074fd2643b43e25 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:39.763008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:39.765429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.899786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1de39e-7456-4e0c-977f-b0e78731a423 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.944001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3e90-f317-486a-9db4-3b36c108e176 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:39.963538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.964162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.964441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.964709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.979039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:39.989469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:39.990399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:39.991470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:39.992075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:39.995509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:40.012526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:40.015156 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a004d0-0648-4a43-a93f-7fc1151891aa service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:40.058204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 969/1936] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:40.064159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.064465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.067973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.103359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:40.107330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:40.124404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:40.125904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:40.139037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 968/1937] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:40.155465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 970/1938] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:40.173353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:40.175474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:40.192461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db377f-7177-4bc0-9992-abbc775e3507 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:40.207132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d22f-d8a3-41f7-a759-f30eb7a2c930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:40.207824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d22f-d8a3-41f7-a759-f30eb7a2c930 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.208099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d22f-d8a3-41f7-a759-f30eb7a2c930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.208364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d22f-d8a3-41f7-a759-f30eb7a2c930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.227865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d22f-d8a3-41f7-a759-f30eb7a2c930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:40.229397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d22f-d8a3-41f7-a759-f30eb7a2c930 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:40.236654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:40.259303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 969/1939] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:40.382679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:40.385771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:40.403771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774a97e-4dc7-460e-8f2f-100eedc3dc02 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:40.410996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:40.412044 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.412475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.412762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] PATH_INFO: `/v3/projects/02e12dfc2ffd48aeb554f28add64d17f` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.414058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e12dfc2ffd48aeb554f28add64d17f)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:40.416552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:40.487471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e12dfc2ffd48aeb554f28add64d17f', 'request_id': 'req-859126ec-c23a-494a-bf8d-4053e99b2640'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:40.531746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e12dfc2ffd48aeb554f28add64d17f', 'request_id': 'req-859126ec-c23a-494a-bf8d-4053e99b2640'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:40.545128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e12dfc2ffd48aeb554f28add64d17f', 'request_id': 'req-859126ec-c23a-494a-bf8d-4053e99b2640'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:40.578006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] The token cache is being invalidate because project 02e12dfc2ffd48aeb554f28add64d17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:40.580676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:40.585180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-859126ec-c23a-494a-bf8d-4053e99b2640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:40.595031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 971/1940] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:40 2022] DELETE /identity/v3/projects/02e12dfc2ffd48aeb554f28add64d17f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:40.597465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.597465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.597465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.629565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:40.631970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:40.721941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 970/1941] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:40.731056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.731536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.732048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.754085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:40.755295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:40.767298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 972/1942] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:40.770594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:40.782266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d301e7-7c47-45eb-980e-0d85456c58de None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:40.789412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:40.791537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.791928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.794521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.795548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:40.795910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:40.798516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:40.816649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 971/1943] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:40.821560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:40.833060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d227e-a168-4b0a-9354-f43cdebdb07a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:40.843094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:40.845950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:40.845950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:40.845950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:40.845950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:40.848592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:40.862407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:40.900171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 973/1944] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:40 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:40.901137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:40.913368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a497-cf7e-4a67-9e76-e8e34969ff1e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.018057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.018984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.020090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.020518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.020783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.021603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.023252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.024293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.060206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf11bc-dcc3-4926-849a-63b1cb899a0a admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.069598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.070784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.071162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.071536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] PATH_INFO: `/v3/projects/264bfb3a239242aeaf7d0787dcb2b9b9` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.073901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] RBAC: Authorizing `identity:delete_project(project_id=264bfb3a239242aeaf7d0787dcb2b9b9)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.076699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.077453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 972/1945] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:40 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:41.078535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.081873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.098737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b155-0601-4ddd-96d2-facae6958d04 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.108255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.109263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.109655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.109930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] PATH_INFO: `/v3/projects/dab60761070944eab80ec057f535cb38` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.111159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab60761070944eab80ec057f535cb38)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.113612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.163366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264bfb3a239242aeaf7d0787dcb2b9b9', 'request_id': 'req-d1859d92-5539-4cb6-a601-996abe0d942b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.170225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264bfb3a239242aeaf7d0787dcb2b9b9', 'request_id': 'req-d1859d92-5539-4cb6-a601-996abe0d942b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.172895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab60761070944eab80ec057f535cb38', 'request_id': 'req-215283d0-7362-4e7a-a96f-c70fc274f268'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.178087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264bfb3a239242aeaf7d0787dcb2b9b9', 'request_id': 'req-d1859d92-5539-4cb6-a601-996abe0d942b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.178493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab60761070944eab80ec057f535cb38', 'request_id': 'req-215283d0-7362-4e7a-a96f-c70fc274f268'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.188086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab60761070944eab80ec057f535cb38', 'request_id': 'req-215283d0-7362-4e7a-a96f-c70fc274f268'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.199332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:41.199864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] The token cache is being invalidate because project 264bfb3a239242aeaf7d0787dcb2b9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:41.200209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.201157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.203087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 974/1946] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:41 2022] DELETE /identity/v3/projects/264bfb3a239242aeaf7d0787dcb2b9b9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:41.203989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.207594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.209496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] The token cache is being invalidate because project dab60761070944eab80ec057f535cb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:41.210139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.211745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.219106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 973/1947] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:41 2022] DELETE /identity/v3/projects/dab60761070944eab80ec057f535cb38 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:41.220284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.222095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.303097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215283d0-7362-4e7a-a96f-c70fc274f268 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.305659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1859d92-5539-4cb6-a601-996abe0d942b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.308068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.308999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.309339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.309572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] PATH_INFO: `/v3/users/822e875f65bd4290bb798e052d5b06d6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.310803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=822e875f65bd4290bb798e052d5b06d6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.310953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.312310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.312310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.312310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.312789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.312910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.314490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.326525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 975/1948] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:41.327638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.329963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.345847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20aef9-68a5-46fd-bb23-1964a327ec2b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.350822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.351726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.352007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.352284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] PATH_INFO: `/v3/users/a6cb47ab95f8460c9a9e2b7006fc1887` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.353567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cb47ab95f8460c9a9e2b7006fc1887)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.355464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.372456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822e875f65bd4290bb798e052d5b06d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.389872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822e875f65bd4290bb798e052d5b06d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.391001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822e875f65bd4290bb798e052d5b06d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.391600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822e875f65bd4290bb798e052d5b06d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.399677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18da0c7d-6ed9-4acb-a80d-39a355676aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822e875f65bd4290bb798e052d5b06d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.414412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 974/1949] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:41 2022] DELETE /identity/v3/users/822e875f65bd4290bb798e052d5b06d6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:41.415970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e068e7-4fe6-49dc-b5fa-afe99982d439 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.416138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e068e7-4fe6-49dc-b5fa-afe99982d439 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.416316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e068e7-4fe6-49dc-b5fa-afe99982d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.420343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cb47ab95f8460c9a9e2b7006fc1887'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.451168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:41.452740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cb47ab95f8460c9a9e2b7006fc1887'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.457359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cb47ab95f8460c9a9e2b7006fc1887'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.461565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cb47ab95f8460c9a9e2b7006fc1887'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.475456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cb47ab95f8460c9a9e2b7006fc1887'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:41.494306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-51e068e7-4fe6-49dc-b5fa-afe99982d439 None None] MFA Rules not processed for user `7ce071c53d354b4faf8bcc8b535eef9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:41.495871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-51e068e7-4fe6-49dc-b5fa-afe99982d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.502698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 976/1950] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:41 2022] DELETE /identity/v3/users/a6cb47ab95f8460c9a9e2b7006fc1887 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:41.507796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.509832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.627838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 975/1951] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:41.643094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f09fd0-5b47-4688-b87e-58657c8e9e07 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.643864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.648731 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.649387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.649506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.649800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.650187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.650420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.651080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.654016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.663760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:41.671782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 977/1952] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:41.676533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.684288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] MFA Rules not processed for user `958873085c76404bb8c68efcd6516281`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:41.686251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.699239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0520296-c37a-4e47-bb24-2a5b214d8aba admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:41.710880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c811-7e1d-4910-88f4-b1469b85951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:41.711813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c811-7e1d-4910-88f4-b1469b85951f admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.712090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c811-7e1d-4910-88f4-b1469b85951f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.712788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c811-7e1d-4910-88f4-b1469b85951f admin admin] PATH_INFO: `/v3/projects/e7e8495f4e1b4bc29327578b1d6889bf/users/4e1d3ea9dfe94e20bd8c73b98c94ea97/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.733733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c811-7e1d-4910-88f4-b1469b85951f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e8495f4e1b4bc29327578b1d6889bf, user_id=4e1d3ea9dfe94e20bd8c73b98c94ea97, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:41.737926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c811-7e1d-4910-88f4-b1469b85951f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:41.756800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 978/1953] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:41 2022] PUT /identity/v3/projects/e7e8495f4e1b4bc29327578b1d6889bf/users/4e1d3ea9dfe94e20bd8c73b98c94ea97/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:41.785533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:41.786058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:41.803115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:41.812542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 976/1954] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:41.823899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.826069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.844407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] MFA Rules not processed for user `4e1d3ea9dfe94e20bd8c73b98c94ea97`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:41.845702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.932281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 979/1955] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:41.944273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:41.945967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:41.994350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9669-df35-4802-88db-be72e5cd7d78 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.019358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:42.037158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4b59a-9795-41b5-b9a3-8fd58e79e583 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.048705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.049397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.049846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.050198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.079466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.084440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.105154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 980/1956] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:42.106424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.108437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.141545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.142246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.143245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.143379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.148220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.223104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbff5-8bc4-4a64-8edb-28704a3d1276 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.235381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:42.238656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.239758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.240032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.240306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] PATH_INFO: `/v3/projects/5f44bdb366da40368201d68847c29c6e` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.242031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f44bdb366da40368201d68847c29c6e)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.246531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.258307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.260596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.274260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 977/1957] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:42.274918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.276814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.304184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e35b8-aae9-4ecc-a759-98e678a953f6 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.313590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.315558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.316518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.317425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] PATH_INFO: `/v3/projects/9fa3cb403a2947d0af59e75925c46491` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.320162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa3cb403a2947d0af59e75925c46491)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.323943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.362832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f44bdb366da40368201d68847c29c6e', 'request_id': 'req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.381602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f44bdb366da40368201d68847c29c6e', 'request_id': 'req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.391893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f44bdb366da40368201d68847c29c6e', 'request_id': 'req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.398996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa3cb403a2947d0af59e75925c46491', 'request_id': 'req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.407306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa3cb403a2947d0af59e75925c46491', 'request_id': 'req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.422181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa3cb403a2947d0af59e75925c46491', 'request_id': 'req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.431677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] The token cache is being invalidate because project 5f44bdb366da40368201d68847c29c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:42.448795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.448795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-daeb70a1-21cd-4a8d-8ec3-99cbbae3ac52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.448795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 981/1958] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:42 2022] DELETE /identity/v3/projects/5f44bdb366da40368201d68847c29c6e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:42.448795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad2e6-62ab-4cc1-8015-da0dd5dd8818 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.448795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad2e6-62ab-4cc1-8015-da0dd5dd8818 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.448795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad2e6-62ab-4cc1-8015-da0dd5dd8818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.458671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] The token cache is being invalidate because project 9fa3cb403a2947d0af59e75925c46491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:42.459051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.460779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ce3d8c6d-ce6b-402d-8767-d317d1fd8bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:42.465295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 978/1959] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:42 2022] DELETE /identity/v3/projects/9fa3cb403a2947d0af59e75925c46491 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:42.469777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8530ea-bedd-442c-b16c-ecb5bc49f0d7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.470379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8530ea-bedd-442c-b16c-ecb5bc49f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.470741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8530ea-bedd-442c-b16c-ecb5bc49f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.481551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-0eaad2e6-62ab-4cc1-8015-da0dd5dd8818 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:42.483005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0eaad2e6-62ab-4cc1-8015-da0dd5dd8818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.499540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9e8530ea-bedd-442c-b16c-ecb5bc49f0d7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:42.501163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9e8530ea-bedd-442c-b16c-ecb5bc49f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.560972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 982/1960] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:42.570925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.572509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.572794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.595297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 979/1961] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:42.600473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.600763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.601041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.637562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:42.638803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.641217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:42.642534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:42.655915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 980/1962] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:42.657315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.667765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 983/1963] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:42.668677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.672450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e7b23-b59d-463e-8f61-afe56494819f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.680774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.682212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.682640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.683009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.683848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:42.684260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.686225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.692580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89647dc9-86da-4c1a-922e-9c5ce1bed180 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.704735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.705485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.705767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.706033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.707252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 981/1964] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:42.708165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.710627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:42.711003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.713102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.726756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:42.736652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 984/1965] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:42.738037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68660e1-5860-4fba-8d2d-cd8c6e77c190 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.738743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.745025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.745953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.746391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.746870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.748154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.750879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.754529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52136a-c9ec-4088-973f-bad5ce2d1db9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.760495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.761189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.761512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.762043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.762959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.765028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.799914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 982/1966] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:42.801308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.810339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 985/1967] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:42.814661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:42.851034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:42.912515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfcdf9-fb4b-4d1f-a302-753ed45a0bd1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.943693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d547-8a60-45ce-90a7-dfac1776e1b0 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:42.951751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:42.952530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:42.953115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:42.953395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:42.955075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:42.957551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:42.993317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 986/1968] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:42.997480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.021949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5816de2-fe4f-4c45-a06f-56e98a3e0e52 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.022198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.023290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.023632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.023974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.025676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.028323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.034165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.035130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.035607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.036195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.037128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.039417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.055166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 987/1969] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:43.057385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.075019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 983/1970] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:42 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:43.076450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.090785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438f1d-b34c-491a-93e5-e3c1df32785f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.093615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.094079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.094443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.094833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.096553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.099080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7cc4-10e6-4be7-905a-3da6d946bd3e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.103250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.113098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.114634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.115009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.115289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.118067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.120646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.125372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 988/1971] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:43.129878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.138135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 984/1972] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:43.142531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.155347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53342135-f95c-48db-a8ed-af8d14f169e0 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.159342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a43a2c-0790-4394-bf41-d784d061c6d2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.166104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff82ddc-2189-4ee9-a5df-4e6c2ff47605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.167093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82ddc-2189-4ee9-a5df-4e6c2ff47605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.167681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82ddc-2189-4ee9-a5df-4e6c2ff47605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.168022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82ddc-2189-4ee9-a5df-4e6c2ff47605 admin admin] PATH_INFO: `/v3/projects/4d1d03458fb5413f95ca2f98999a0bd0/users/5b4d11510c494e5dbd2a474f89663353/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.168255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.169186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.169509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.169867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.171000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.172954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.193752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 985/1973] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:14:43.199441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.204439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff82ddc-2189-4ee9-a5df-4e6c2ff47605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1d03458fb5413f95ca2f98999a0bd0, user_id=5b4d11510c494e5dbd2a474f89663353, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.207476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff82ddc-2189-4ee9-a5df-4e6c2ff47605 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.214065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727b69b-efe0-4d25-bc7b-bd08121c879b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.224276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68f562-f3f0-4876-8171-196b1ba7caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.225733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68f562-f3f0-4876-8171-196b1ba7caa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.227762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68f562-f3f0-4876-8171-196b1ba7caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.228208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68f562-f3f0-4876-8171-196b1ba7caa6 admin admin] PATH_INFO: `/v3/projects/d0c12eaeea804871882252f2d18ae7e5/users/a1ad5ee7fc0640eba1232160c5f8ba5a/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.245847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 989/1974] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:43 2022] PUT /identity/v3/projects/4d1d03458fb5413f95ca2f98999a0bd0/users/5b4d11510c494e5dbd2a474f89663353/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:43.248130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.248414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.248687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.256949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68f562-f3f0-4876-8171-196b1ba7caa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c12eaeea804871882252f2d18ae7e5, user_id=a1ad5ee7fc0640eba1232160c5f8ba5a, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.261907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68f562-f3f0-4876-8171-196b1ba7caa6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.282450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 986/1975] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:43 2022] PUT /identity/v3/projects/d0c12eaeea804871882252f2d18ae7e5/users/a1ad5ee7fc0640eba1232160c5f8ba5a/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:43.296603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.297936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.298223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.333120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] MFA Rules not processed for user `a1ad5ee7fc0640eba1232160c5f8ba5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:43.334402 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:43.355934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] MFA Rules not processed for user `5b4d11510c494e5dbd2a474f89663353`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:43.357124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:43.454915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 987/1976] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:43.468085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.469956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:43.478374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:43.594815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 990/1977] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:43.599370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.617274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:43.657471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b16d3-30b0-4c91-abe3-62da5cc35300 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.668428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.669361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.670274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.670652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.682128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.683942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.696303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 988/1978] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:43.790953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa8f4-c064-432f-8c0f-c919149fd35f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:43.804319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:43.807265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:43.807690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:43.807985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:43.808803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:43.813995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:43.898567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 991/1979] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:43 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:43.903386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:43.919048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff9b4-2659-4edc-b313-e72156dcd1f2 service glance] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.033874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.035851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.035851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.036155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.037096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:44.039176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:44.068733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 989/1980] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:43 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:44.076146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:44.135017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d561-c13a-4008-9d56-637e796f43d7 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.146573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.147267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.147539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.147791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.148742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:44.150896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:44.165976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 992/1981] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:44.170716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:44.187867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785472b-70e0-4017-b803-f557bf4b8cdf admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.204653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.210463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.210605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.211087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] PATH_INFO: `/v3/projects/0232f32275944b9381154276026d6080/users/a964448b72604f11a126ce199ac8d1e4/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.239875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0232f32275944b9381154276026d6080, user_id=a964448b72604f11a126ce199ac8d1e4, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:44.244166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:44.266167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 990/1982] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:44 2022] PUT /identity/v3/projects/0232f32275944b9381154276026d6080/users/a964448b72604f11a126ce199ac8d1e4/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:44.270212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:44.286359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3053d55-38a9-4351-b932-8850e1aa1996 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.401260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f54b5-68d4-4c5e-9d0c-5d797436eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.402278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f54b5-68d4-4c5e-9d0c-5d797436eb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.402730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f54b5-68d4-4c5e-9d0c-5d797436eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.404739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f54b5-68d4-4c5e-9d0c-5d797436eb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.405826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f54b5-68d4-4c5e-9d0c-5d797436eb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:44.411110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f54b5-68d4-4c5e-9d0c-5d797436eb32 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:44.430251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 993/1983] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:44.435026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:44.449957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9526733-3c15-43da-8388-86fcd061856f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.463661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.464816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.465167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.465529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] PATH_INFO: `/v3/projects/0232f32275944b9381154276026d6080/users/a964448b72604f11a126ce199ac8d1e4/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.468245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0232f32275944b9381154276026d6080, user_id=a964448b72604f11a126ce199ac8d1e4, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:44.472397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:44.488608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 991/1984] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:44 2022] PUT /identity/v3/projects/0232f32275944b9381154276026d6080/users/a964448b72604f11a126ce199ac8d1e4/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:44.500965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.501371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.501652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.549917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] MFA Rules not processed for user `a964448b72604f11a126ce199ac8d1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:44.551670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:44.651492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 994/1985] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:44.669565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:44.671619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:44.726660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:44.745276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2d291-fb6e-4434-8765-1715d303e545 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.750137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.750863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.751135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.751401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:44.763021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:44.764688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:44.776256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 992/1986] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:44.913271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:44.914767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:44.923374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:44.935820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322f3ae-7b20-4b78-aa28-8b05b606e450 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:44.945898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad36e5-aed7-43f4-9864-207ceb5bb981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:44.946946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad36e5-aed7-43f4-9864-207ceb5bb981 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:44.947413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad36e5-aed7-43f4-9864-207ceb5bb981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:44.947658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad36e5-aed7-43f4-9864-207ceb5bb981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:45.050471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad36e5-aed7-43f4-9864-207ceb5bb981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:45.052094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad36e5-aed7-43f4-9864-207ceb5bb981 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:45.069346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 995/1987] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:14:48.273421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:48.386359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60545996-ee0c-4504-afa0-313b3adc1b13 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:48.396282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:48.397618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:48.398196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:48.398777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] PATH_INFO: `/v3/users/5b4d11510c494e5dbd2a474f89663353` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:48.401507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4d11510c494e5dbd2a474f89663353)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:48.404490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:48.478126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4d11510c494e5dbd2a474f89663353'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:48.526715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4d11510c494e5dbd2a474f89663353'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:48.527661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4d11510c494e5dbd2a474f89663353'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:48.528279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4d11510c494e5dbd2a474f89663353'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:48.537563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4d11510c494e5dbd2a474f89663353'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:48.570876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 993/1988] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:48 2022] DELETE /identity/v3/users/5b4d11510c494e5dbd2a474f89663353 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:48.575840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:48.577114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:48.577668 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:48.634106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:48.645733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:48.781482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 996/1989] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:48.792075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:48.793186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:48.954257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4124a-8c6b-437c-aeac-0412b04d6396 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:48.958940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:48.959791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:48.960186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:48.960623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:48.972771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:48.974450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:48.992303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 994/1990] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:49.877447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:49.879411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:49.906521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294981e-b5b3-4a92-a06a-c13818d2b1c1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:49.912548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:49.913879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:49.914212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:49.914493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] PATH_INFO: `/v3/projects/4d1d03458fb5413f95ca2f98999a0bd0` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:49.915789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1d03458fb5413f95ca2f98999a0bd0)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:49.934029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:50.051749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1d03458fb5413f95ca2f98999a0bd0', 'request_id': 'req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.065719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1d03458fb5413f95ca2f98999a0bd0', 'request_id': 'req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.081430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1d03458fb5413f95ca2f98999a0bd0', 'request_id': 'req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.119999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] The token cache is being invalidate because project 4d1d03458fb5413f95ca2f98999a0bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:50.120526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.122805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.126696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 997/1991] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:49 2022] DELETE /identity/v3/projects/4d1d03458fb5413f95ca2f98999a0bd0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:50.130905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:50.139183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:50.144014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cabeab-940a-4178-a4e9-e2090dc687a4 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:50.299526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:50.300431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:50.301024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:50.301223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] PATH_INFO: `/v3/users/a964448b72604f11a126ce199ac8d1e4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:50.302723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a964448b72604f11a126ce199ac8d1e4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:50.304696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:50.365201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a964448b72604f11a126ce199ac8d1e4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.380383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a964448b72604f11a126ce199ac8d1e4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.381198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a964448b72604f11a126ce199ac8d1e4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.381968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a964448b72604f11a126ce199ac8d1e4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.390780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-592f353e-a593-44fa-afb6-09fc372544c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a964448b72604f11a126ce199ac8d1e4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:50.411444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 995/1992] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:50 2022] DELETE /identity/v3/users/a964448b72604f11a126ce199ac8d1e4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:50.742717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:50.744420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:50.769360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2b61-caa0-48b1-bb44-fa4d4eaf3e8c admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:50.799398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:50.855538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:50.856547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:50.856840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:50.858566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] PATH_INFO: `/v3/projects/0232f32275944b9381154276026d6080` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:50.860517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0232f32275944b9381154276026d6080)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:50.862812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:50.994404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0232f32275944b9381154276026d6080', 'request_id': 'req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:51.002405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0232f32275944b9381154276026d6080', 'request_id': 'req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:51.012981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0232f32275944b9381154276026d6080', 'request_id': 'req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:51.035752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] The token cache is being invalidate because project 0232f32275944b9381154276026d6080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:51.043447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:51.044304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4f6ad1bb-7936-4d7a-931d-2170410a6b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:51.046220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 998/1993] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:50 2022] DELETE /identity/v3/projects/0232f32275944b9381154276026d6080 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:51.051007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.051329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.051569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.074365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:51.075896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:51.168615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 996/1994] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:51.177047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.177563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.177776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.204084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:51.205448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:51.220226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 999/1995] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:51.225193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:51.242575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3649f-7119-4881-a81e-7e2d398b54f9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:51.251148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:51.252100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.252483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.252858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.253965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:51.254983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:51.257490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:51.274424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 997/1996] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:51.279910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:51.314491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f023b75-6bd2-4af4-a0a5-8231d8ce8eed None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:51.319681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:51.320497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.321456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.321456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.322853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:51.325091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:51.379275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1000/1997] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:51 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:51.383491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:51.401171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8521-35d0-40ca-b318-d2ad7132906a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:51.414837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:51.562059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:51.563715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.565518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.566063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.568102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:51.576816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:51.622911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 998/1998] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:51 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:51.627380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:51.639915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591dcb-1b7f-4901-bf26-ac373818028c admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:51.656235 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:51.657328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.657772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.658197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.659741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:51.661684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:51.681586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1001/1999] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:51.682480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:51.695355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db82b0-eecc-44f1-86dc-460c6efad5c9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:51.700769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6cf98-230f-415c-b27e-b1e486a8b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:51.702957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cf98-230f-415c-b27e-b1e486a8b6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.703357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cf98-230f-415c-b27e-b1e486a8b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.703702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cf98-230f-415c-b27e-b1e486a8b6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.704551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6cf98-230f-415c-b27e-b1e486a8b6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:51.706677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6cf98-230f-415c-b27e-b1e486a8b6b7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:51.729650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 999/2000] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:51.733553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:51.747313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92987-2129-42da-a826-6e4ccdd9a3e0 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:51.752718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:51.753788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.754715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.754715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] PATH_INFO: `/v3/projects/06d55e12ab1c440787b0e51ad7ae02a6/users/9ad0b1d8d8c84006a1a5bdbfa55e88bc/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.779437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d55e12ab1c440787b0e51ad7ae02a6, user_id=9ad0b1d8d8c84006a1a5bdbfa55e88bc, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:51.783153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:51.815346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1002/2001] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:51 2022] PUT /identity/v3/projects/06d55e12ab1c440787b0e51ad7ae02a6/users/9ad0b1d8d8c84006a1a5bdbfa55e88bc/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:51.819169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:51.819747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:51.820238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:51.898307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] MFA Rules not processed for user `9ad0b1d8d8c84006a1a5bdbfa55e88bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:51.900146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:52.022729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1000/2002] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:52.023969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.094929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:52.111496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d1a75-d670-4af6-a567-cb73c7b4f6fa admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.117411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.118105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.118381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.118712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.119869 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.121892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.163498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1003/2003] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:52 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:52.164674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.178895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc229-a41a-4a1d-8e6f-057b281d4b13 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.239739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.240660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.240933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.241217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.241974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.244026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.267973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1001/2004] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:52 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:52.272181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.283725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfe0f6-a579-4dda-b824-ca627a717ea3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.289457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.290154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.290496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.290841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.293291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.296552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.309813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1004/2005] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:52.311221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.324420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8124a37-8caa-4b17-993e-c369688b4ee3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.342711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.343738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.344028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.344299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] PATH_INFO: `/v3/projects/e60e80e9cea24304a5c51a3fafb6e7a6/users/8769b112f8364ccd93c8fbfddb39b9ce/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.348126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:52.367418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60e80e9cea24304a5c51a3fafb6e7a6, user_id=8769b112f8364ccd93c8fbfddb39b9ce, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.370272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.387231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1002/2006] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:52 2022] PUT /identity/v3/projects/e60e80e9cea24304a5c51a3fafb6e7a6/users/8769b112f8364ccd93c8fbfddb39b9ce/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:52.391575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.402556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4e5e-5a48-46aa-8b23-5871e8d5b630 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.481360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed86576-de35-4c77-a665-34d21335bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.482102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed86576-de35-4c77-a665-34d21335bbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.482386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed86576-de35-4c77-a665-34d21335bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.482642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed86576-de35-4c77-a665-34d21335bbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.483420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed86576-de35-4c77-a665-34d21335bbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.485109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed86576-de35-4c77-a665-34d21335bbb0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.497262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1005/2007] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:52.501358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.512490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55640f-0342-4430-943b-56c3ef17bccb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.517452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.518416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.518702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.518976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] PATH_INFO: `/v3/projects/e60e80e9cea24304a5c51a3fafb6e7a6/users/8769b112f8364ccd93c8fbfddb39b9ce/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.522328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60e80e9cea24304a5c51a3fafb6e7a6, user_id=8769b112f8364ccd93c8fbfddb39b9ce, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.527025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.538628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1003/2008] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:52 2022] PUT /identity/v3/projects/e60e80e9cea24304a5c51a3fafb6e7a6/users/8769b112f8364ccd93c8fbfddb39b9ce/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:52.550189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.550474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.550799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.579933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] MFA Rules not processed for user `8769b112f8364ccd93c8fbfddb39b9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:52.581377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:52.665049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1006/2009] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:52.678463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:52.680362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:52.744518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbe9d4-7397-421c-b2ef-07403efec6fd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:52.748374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:52.749032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:52.749412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:52.749685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:52.759433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:52.761257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:52.770998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1004/2010] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:53.124747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:53.135680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76535-9528-4236-9b81-dde1a5cc5ee4 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:53.140213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8769b112f8364ccd93c8fbfddb39b9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:53.141014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:53.141325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:53.141605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:53.142487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:53.142805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:53.144419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:53.160977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1007/2011] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:53.162611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:53.173734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187af3-1dff-45f4-9cba-7c6d9e5b3859 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:53.179606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8769b112f8364ccd93c8fbfddb39b9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:53.180404 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:53.180731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:53.182255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:53.183466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:53.185490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:53.223437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1005/2012] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:53 2022] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:53.228560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:53.240488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84758-88c1-4483-a842-8ebe9c7ad4f2 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:53.295239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:53.354499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8769b112f8364ccd93c8fbfddb39b9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:53.355192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:53.355617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:53.356076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:53.356829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:53.357143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:53.358814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:53.373486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1008/2013] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:53.440173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:53.452334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0aa26-c8ac-4b9a-83d8-aea8ad5afce9 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:53.457621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8769b112f8364ccd93c8fbfddb39b9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:53.458702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:53.458984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:53.459233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] PATH_INFO: `/v3/projects/2943dd6ffd2f485da009438e886d34c8` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:53.460499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2943dd6ffd2f485da009438e886d34c8)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:53.463139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:53.542462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2943dd6ffd2f485da009438e886d34c8', 'request_id': 'req-0ff42915-49bb-4931-85b8-fffa8ce7825d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:53.550521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2943dd6ffd2f485da009438e886d34c8', 'request_id': 'req-0ff42915-49bb-4931-85b8-fffa8ce7825d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:53.563172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2943dd6ffd2f485da009438e886d34c8', 'request_id': 'req-0ff42915-49bb-4931-85b8-fffa8ce7825d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:53.582634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] The token cache is being invalidate because project 2943dd6ffd2f485da009438e886d34c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:53.582917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:53.583599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:53.585219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1006/2014] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:53 2022] DELETE /identity/v3/projects/2943dd6ffd2f485da009438e886d34c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:53.755403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:53.758491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:53.794906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:53.796473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:53.841920 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d144f6-da44-448b-8c36-38378a18e821 tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:53.848861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:53.885805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42915-49bb-4931-85b8-fffa8ce7825d tempest-VolumeQuotaClassesTest-800068751 tempest-VolumeQuotaClassesTest-800068751-project-admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:53.890998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:53.892279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:53.892628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:53.893024 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] PATH_INFO: `/v3/users/9ad0b1d8d8c84006a1a5bdbfa55e88bc` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:53.894703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad0b1d8d8c84006a1a5bdbfa55e88bc)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:53.897760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:53.920766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:53.922056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:53.922537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:53.922995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] PATH_INFO: `/v3/users/4e1d3ea9dfe94e20bd8c73b98c94ea97` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:53.924421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1d3ea9dfe94e20bd8c73b98c94ea97)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:53.926737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:54.001588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad0b1d8d8c84006a1a5bdbfa55e88bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.002275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1d3ea9dfe94e20bd8c73b98c94ea97'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.022484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1d3ea9dfe94e20bd8c73b98c94ea97'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.023350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1d3ea9dfe94e20bd8c73b98c94ea97'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.024384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1d3ea9dfe94e20bd8c73b98c94ea97'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.034859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d17e32cd-d66f-468f-92e5-87404c891f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1d3ea9dfe94e20bd8c73b98c94ea97'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.043939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:54.044150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad0b1d8d8c84006a1a5bdbfa55e88bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.044554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad0b1d8d8c84006a1a5bdbfa55e88bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.045857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad0b1d8d8c84006a1a5bdbfa55e88bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.058094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1009/2015] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:53 2022] DELETE /identity/v3/users/4e1d3ea9dfe94e20bd8c73b98c94ea97 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:54.064053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:54.065211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:54.065605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:54.070639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-837af20b-6a68-427d-a1c7-4d081b8450c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad0b1d8d8c84006a1a5bdbfa55e88bc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:54.111192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1007/2016] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:53 2022] DELETE /identity/v3/users/9ad0b1d8d8c84006a1a5bdbfa55e88bc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:54.116010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:54.119031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:54.120151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:54.120813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:54.121169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:54.167125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:54.168484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:54.245369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1010/2017] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:54.288676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:54.296965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:54.385284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1008/2018] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:54.414344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6e5ff-a080-4984-bd4a-69aa7767c817 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:54.419625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:54.420215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:54.420492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:54.420763 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:54.433295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:54.434795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:54.436659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:54.446987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1011/2019] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:54.450780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b96e0-69df-426a-9010-836cb86e9d70 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:54.460265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:54.461456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:54.461709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:54.462398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:54.473988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:54.475557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:54.488368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1009/2020] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:55.313922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.315721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:55.332276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.333837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:55.335167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec30b71-4c4f-4cf8-8a04-465c4a54864e service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.340711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.341651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.341924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.342192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] PATH_INFO: `/v3/projects/e7e8495f4e1b4bc29327578b1d6889bf` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.343397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e8495f4e1b4bc29327578b1d6889bf)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.345620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.359532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eae40f-beee-45fd-bb24-f86a32be0b25 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.365513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.366950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.367230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.367693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] PATH_INFO: `/v3/projects/06d55e12ab1c440787b0e51ad7ae02a6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.369501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d55e12ab1c440787b0e51ad7ae02a6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.387120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.403523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e8495f4e1b4bc29327578b1d6889bf', 'request_id': 'req-25bef79a-cf35-490b-ade0-421ab924195d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.409814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e8495f4e1b4bc29327578b1d6889bf', 'request_id': 'req-25bef79a-cf35-490b-ade0-421ab924195d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.419469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e8495f4e1b4bc29327578b1d6889bf', 'request_id': 'req-25bef79a-cf35-490b-ade0-421ab924195d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.436043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] The token cache is being invalidate because project e7e8495f4e1b4bc29327578b1d6889bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:55.436293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.437067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25bef79a-cf35-490b-ade0-421ab924195d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.438932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1012/2021] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:55 2022] DELETE /identity/v3/projects/e7e8495f4e1b4bc29327578b1d6889bf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:55.443906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ead3c-677c-4e5e-939e-3b8415391be3 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.444189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ead3c-677c-4e5e-939e-3b8415391be3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.444461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ead3c-677c-4e5e-939e-3b8415391be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.452702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:55.465362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d55e12ab1c440787b0e51ad7ae02a6', 'request_id': 'req-a575dd66-c58a-4a69-ae53-a4f2335825a3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.472854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d55e12ab1c440787b0e51ad7ae02a6', 'request_id': 'req-a575dd66-c58a-4a69-ae53-a4f2335825a3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.476028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-427ead3c-677c-4e5e-939e-3b8415391be3 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:55.477336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-427ead3c-677c-4e5e-939e-3b8415391be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:55.485138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d55e12ab1c440787b0e51ad7ae02a6', 'request_id': 'req-a575dd66-c58a-4a69-ae53-a4f2335825a3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.492123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:55.504274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] The token cache is being invalidate because project 06d55e12ab1c440787b0e51ad7ae02a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:55.504589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.505292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.506952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1010/2022] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:55 2022] DELETE /identity/v3/projects/06d55e12ab1c440787b0e51ad7ae02a6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:55.513001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.514363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:55.555361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1013/2023] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:55.558809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.559165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.559470 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.579519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:55.581008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:55.586000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575dd66-c58a-4a69-ae53-a4f2335825a3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.590814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1014/2024] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:55.593050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.594171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.594531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.594813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] PATH_INFO: `/v3/users/8769b112f8364ccd93c8fbfddb39b9ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.595734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.596339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] RBAC: Authorizing `identity:delete_user(user_id=8769b112f8364ccd93c8fbfddb39b9ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.600221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.609087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636abb-7d44-4e7f-a6f3-fcb8713490dd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.616480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.617428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.617709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.617979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.619433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:55.619891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.621600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.645323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1015/2025] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:14:55.647366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.661947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21d2ee-9749-41b5-ba98-f33d1cb1e2b5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.664460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8769b112f8364ccd93c8fbfddb39b9ce'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.666935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.667698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.668027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.668286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.668962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.671071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.678794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8769b112f8364ccd93c8fbfddb39b9ce'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.679589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8769b112f8364ccd93c8fbfddb39b9ce'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.680644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8769b112f8364ccd93c8fbfddb39b9ce'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.689221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8769b112f8364ccd93c8fbfddb39b9ce'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:55.701221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1016/2026] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:55 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:55.715260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1011/2027] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:14:55 2022] DELETE /identity/v3/users/8769b112f8364ccd93c8fbfddb39b9ce => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:55.715641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.717696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:55.789002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f76c4-c853-47cf-8358-7db719cdeb59 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.850442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.851119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.851554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.851834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.852551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.854691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.879873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1017/2028] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:55 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:55.884239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.894507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5788402-15a2-4334-9a1d-1c23ab99fada admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.899349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.900264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.900761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.901059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.902026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.904787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.915552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1012/2029] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:14:55.919749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.930420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde99d-3adf-4865-9934-4d21423a5be3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.935488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.936188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.936463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.936711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.937518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.939145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:55.950974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1018/2030] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:55.955352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:55.968210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33791-a108-4a0e-98dd-6f3643c55d61 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:55.973682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c7a8b-3c36-400d-9dbd-f0f814a68675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:55.974657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7a8b-3c36-400d-9dbd-f0f814a68675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:55.975421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7a8b-3c36-400d-9dbd-f0f814a68675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:55.975421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7a8b-3c36-400d-9dbd-f0f814a68675 admin admin] PATH_INFO: `/v3/projects/10f80272ddbd4d3e99aeae46dc961843/users/883a1f25631d453abbbdf55e2aa85b2d/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:55.992779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c7a8b-3c36-400d-9dbd-f0f814a68675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f80272ddbd4d3e99aeae46dc961843, user_id=883a1f25631d453abbbdf55e2aa85b2d, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:55.995621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c7a8b-3c36-400d-9dbd-f0f814a68675 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.011524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.013429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.019268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1013/2031] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:55 2022] PUT /identity/v3/projects/10f80272ddbd4d3e99aeae46dc961843/users/883a1f25631d453abbbdf55e2aa85b2d/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:56.023085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.023423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.024097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.045219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:56.048101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.050846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:56.051798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:56.055251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c69ed-30fe-4573-ac19-1085ffe9a1c8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.131886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1014/2032] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:56.143995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.145525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.150274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.151374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.151670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.151921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] PATH_INFO: `/v3/projects/e60e80e9cea24304a5c51a3fafb6e7a6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.153148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60e80e9cea24304a5c51a3fafb6e7a6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.155310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.216350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'request_id': 'req-cbcf3393-cf8a-4b55-acb0-c878e6044865'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:56.217140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7327912-ca9d-4e17-9327-2ce5dae06dcb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.222285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'request_id': 'req-cbcf3393-cf8a-4b55-acb0-c878e6044865'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:56.230472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60e80e9cea24304a5c51a3fafb6e7a6', 'request_id': 'req-cbcf3393-cf8a-4b55-acb0-c878e6044865'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:56.248177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] The token cache is being invalidate because project e60e80e9cea24304a5c51a3fafb6e7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:14:56.248464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:56.249652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cbcf3393-cf8a-4b55-acb0-c878e6044865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:14:56.251288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1019/2033] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:14:56 2022] DELETE /identity/v3/projects/e60e80e9cea24304a5c51a3fafb6e7a6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:56.256305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.256659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.256931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.275408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.276187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.276466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.276736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.278578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.278962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:56.280196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.350151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.351757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676981db-3e38-47ac-bc66-565eb171e7c7 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.361955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1020/2034] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:56.362480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1015/2035] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:14:56.369615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.369908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.370185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.392793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:56.394057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.403087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1016/2036] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:14:56.407833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.433941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e8fe-011d-4e3c-91b8-233986b34969 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.433941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.433941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.433941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.434452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.434452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:14:56.434452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.434452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.453738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1021/2037] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:14:56.454572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.473508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154fefb-02bc-439e-a0a6-7e81d072d5f6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.479927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.480934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.481266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.481537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.482256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.484861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.492412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:56.519882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1017/2038] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/projects => generated 393 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:56.524477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.540388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0cd10-94fd-4387-b5a0-e97ad8880c14 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.562688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:56.606649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.607447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.607724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.608000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.608761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.611025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.641422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1022/2039] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:56.643972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.655964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8d22c-aeb0-4ea0-be5d-3d1de8245e4b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.660959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.661668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.662039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.662324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.663206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.665044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.681267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1018/2040] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:14:56.682599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.694954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdd761-e4c0-4694-89bc-c6fdb1beb585 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.703491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2962df-266a-4a8a-b0aa-0f7240b399e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.704455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2962df-266a-4a8a-b0aa-0f7240b399e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.705179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2962df-266a-4a8a-b0aa-0f7240b399e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.705806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2962df-266a-4a8a-b0aa-0f7240b399e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.707291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2962df-266a-4a8a-b0aa-0f7240b399e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.709036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2962df-266a-4a8a-b0aa-0f7240b399e3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.724645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1023/2041] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:56.729476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:56.741331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e9ce-eb50-4b1d-88c7-8986ea77a68c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:56.754711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:56.756142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.756142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.756369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] PATH_INFO: `/v3/projects/2db7c688e2dd4d498ea23d88e0209295/users/7728b3b3a0684cbfb443060ac2e6c80b/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.779037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db7c688e2dd4d498ea23d88e0209295, user_id=7728b3b3a0684cbfb443060ac2e6c80b, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:56.782086 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:56.801264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1019/2042] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:56 2022] PUT /identity/v3/projects/2db7c688e2dd4d498ea23d88e0209295/users/7728b3b3a0684cbfb443060ac2e6c80b/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:14:56.813261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:56.813936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:56.814892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:56.850245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] MFA Rules not processed for user `7728b3b3a0684cbfb443060ac2e6c80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:56.852647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:56.972919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1024/2043] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:56.973955 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.051703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45c7d-8067-452f-b886-1de642220642 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.058904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.059597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.059872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.060206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.061076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.063161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.091325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1020/2044] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:14:56 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:14:57.095456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.111484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedeff7-1656-4676-8748-d06eaa5516c5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.186537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.187244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.187526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.187812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.188579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.190756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.219851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1025/2045] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:14:57 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:14:57.225102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.251905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf072e06-d4a2-40c2-9641-b17b9f4f6684 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.257595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.259389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.259389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.259389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.261098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.261785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.275776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1021/2046] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:57.279503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.292167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e9a9-6664-41c0-ae8f-b538d6aead5a admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.303614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.304728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.305162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.305599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] PATH_INFO: `/v3/projects/4cab796b97394526b8617cc56b60195c/users/950c2d84a0ad4672a3d4e884ff5e07a7/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.321714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cab796b97394526b8617cc56b60195c, user_id=950c2d84a0ad4672a3d4e884ff5e07a7, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.324505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.328380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:57.346762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1026/2047] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:57 2022] PUT /identity/v3/projects/4cab796b97394526b8617cc56b60195c/users/950c2d84a0ad4672a3d4e884ff5e07a7/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:57.351017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.362496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4c8f-27e6-4633-ad13-b744903ec081 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.447093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1e18e-7b73-416a-b9e6-b026dbbf9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.447859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e18e-7b73-416a-b9e6-b026dbbf9d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.448142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e18e-7b73-416a-b9e6-b026dbbf9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.448410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e18e-7b73-416a-b9e6-b026dbbf9d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.450533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1e18e-7b73-416a-b9e6-b026dbbf9d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.453321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1e18e-7b73-416a-b9e6-b026dbbf9d7b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.469725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1022/2048] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:14:57.474172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.487307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad7cd-d549-48a6-91bc-63221fb96cdb admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.497317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.498348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.499440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.499685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] PATH_INFO: `/v3/projects/4cab796b97394526b8617cc56b60195c/users/950c2d84a0ad4672a3d4e884ff5e07a7/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.501857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cab796b97394526b8617cc56b60195c, user_id=950c2d84a0ad4672a3d4e884ff5e07a7, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.505966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.537799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1027/2049] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:14:57 2022] PUT /identity/v3/projects/4cab796b97394526b8617cc56b60195c/users/950c2d84a0ad4672a3d4e884ff5e07a7/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:14:57.542164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.542506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.542733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.586832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] MFA Rules not processed for user `950c2d84a0ad4672a3d4e884ff5e07a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:14:57.588788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:57.601647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:57.715626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1023/2050] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:14:57.727224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.729746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:57.852118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adbf07-5680-469b-bdd1-21493cd0082d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.856662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.857448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.857971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.858507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:57.873595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:57.875310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:57.896066 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1028/2051] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:14:57.957135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:14:57.958970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:14:57.979783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4fe5-1d53-4ec6-bc8f-14087b809fb8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:14:57.984892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245da3-fe66-482c-b533-b5efc04c8e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:14:57.985689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245da3-fe66-482c-b533-b5efc04c8e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:14:57.986078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245da3-fe66-482c-b533-b5efc04c8e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:14:57.986547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245da3-fe66-482c-b533-b5efc04c8e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:14:58.095530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245da3-fe66-482c-b533-b5efc04c8e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:14:58.097825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245da3-fe66-482c-b533-b5efc04c8e9c service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:14:58.111796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1024/2052] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:02.294918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:02.394055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b708f-3ca7-485a-8d76-168f2f75cb93 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:02.400565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:02.402178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.402607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.403079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] PATH_INFO: `/v3/users/7728b3b3a0684cbfb443060ac2e6c80b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.404473 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7728b3b3a0684cbfb443060ac2e6c80b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:02.406599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:02.482269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.482849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.483070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.489704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7728b3b3a0684cbfb443060ac2e6c80b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:02.506121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7728b3b3a0684cbfb443060ac2e6c80b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:02.506847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7728b3b3a0684cbfb443060ac2e6c80b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:02.507435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7728b3b3a0684cbfb443060ac2e6c80b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:02.515339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d14a6ab8-46a1-4f7c-a6ae-40e69dea540f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7728b3b3a0684cbfb443060ac2e6c80b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:02.516707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] MFA Rules not processed for user `883a1f25631d453abbbdf55e2aa85b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:02.518515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:02.534619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1029/2053] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:02 2022] DELETE /identity/v3/users/7728b3b3a0684cbfb443060ac2e6c80b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:02.543676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.544078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.544530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.552349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:02.566654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:02.568592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:02.598624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1025/2054] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:02.603910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:02.605355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:02.621768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e420a1-8c4a-4afa-84ef-397850652b3f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:02.639426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1030/2055] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:15:02.649198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:02.650893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:02.665466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:02.692103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:02.693645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.693932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.694203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.694941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:02.697513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:02.720242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2cf3-46af-40bf-9bf5-0cea3393b864 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:02.725644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:02.726317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.726588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.726857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.733817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1026/2056] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:02 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:15:02.737553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:02.737940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:02.739115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:02.750327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1031/2057] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:15:02.814589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203a94-48e1-44a9-a2bd-535fe9b920d1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:02.824171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:02.825067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.825424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.825702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.826423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:02.828815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:02.861055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1027/2058] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:02 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:02.862734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:02.873757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124ad4-4e26-4c22-b5e0-ac300cbf625d service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:02.879246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:02.880013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.880300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.880598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.881574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:02.883433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:02.897460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1032/2059] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:15:02.901834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:02.914620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5709c6-3b19-4ebc-9e0e-2746315b7e92 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:02.922948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:02.924006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:02.924352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:02.924721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] PATH_INFO: `/v3/projects/297f1c0c63924e92840001725ff8d5af/users/36f087484fc04062b91829bb5cbd1f61/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:02.982758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297f1c0c63924e92840001725ff8d5af, user_id=36f087484fc04062b91829bb5cbd1f61, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:02.989551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:03.018896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1028/2060] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:02 2022] PUT /identity/v3/projects/297f1c0c63924e92840001725ff8d5af/users/36f087484fc04062b91829bb5cbd1f61/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:03.022667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:03.044893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef885-4445-46fd-aa93-e10572bce836 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:03.197299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:03.201101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:03.201101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:03.201101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:03.201977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:03.203770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:03.220797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1033/2061] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:03.224553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:03.239345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0badf55-af51-408a-87b7-c462dd2b4ea4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:03.247220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:03.248522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:03.248906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:03.249401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] PATH_INFO: `/v3/projects/297f1c0c63924e92840001725ff8d5af/users/36f087484fc04062b91829bb5cbd1f61/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:03.252079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=297f1c0c63924e92840001725ff8d5af, user_id=36f087484fc04062b91829bb5cbd1f61, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:03.255175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:03.276797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:03.279499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:03.288821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1029/2062] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:03 2022] PUT /identity/v3/projects/297f1c0c63924e92840001725ff8d5af/users/36f087484fc04062b91829bb5cbd1f61/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:03.325784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b411-261a-4b32-83b3-56187e0a5b29 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:03.418725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:03.480071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:03.481179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:03.481566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:03.482082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] PATH_INFO: `/v3/projects/2db7c688e2dd4d498ea23d88e0209295` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:03.484484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db7c688e2dd4d498ea23d88e0209295)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:03.489553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:03.599391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db7c688e2dd4d498ea23d88e0209295', 'request_id': 'req-22e1decd-ad66-468b-ab06-bdd559f14cd2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.607206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db7c688e2dd4d498ea23d88e0209295', 'request_id': 'req-22e1decd-ad66-468b-ab06-bdd559f14cd2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.615000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db7c688e2dd4d498ea23d88e0209295', 'request_id': 'req-22e1decd-ad66-468b-ab06-bdd559f14cd2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.633949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] The token cache is being invalidate because project 2db7c688e2dd4d498ea23d88e0209295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:03.634261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.634990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.637265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1034/2063] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:03 2022] DELETE /identity/v3/projects/2db7c688e2dd4d498ea23d88e0209295 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:03.641510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:03.644206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:03.662613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9fa6-dce7-4cf3-86d3-ef97abbd984e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:03.796778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:03.797777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:03.798061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:03.798913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] PATH_INFO: `/v3/users/950c2d84a0ad4672a3d4e884ff5e07a7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:03.800261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950c2d84a0ad4672a3d4e884ff5e07a7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:03.802622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:03.827523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:03.914120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950c2d84a0ad4672a3d4e884ff5e07a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.934189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950c2d84a0ad4672a3d4e884ff5e07a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.935144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950c2d84a0ad4672a3d4e884ff5e07a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.935860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950c2d84a0ad4672a3d4e884ff5e07a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.946009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950c2d84a0ad4672a3d4e884ff5e07a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:03.969334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1030/2064] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:03 2022] DELETE /identity/v3/users/950c2d84a0ad4672a3d4e884ff5e07a7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:04.632240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:04.634613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:04.657074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1decd-ad66-468b-ab06-bdd559f14cd2 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:04.763270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:04.766141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:04.766650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:04.767298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] PATH_INFO: `/v3/users/a1ad5ee7fc0640eba1232160c5f8ba5a` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:04.768897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ad5ee7fc0640eba1232160c5f8ba5a)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:04.771124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:04.903288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:04.905683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:04.923054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ad5ee7fc0640eba1232160c5f8ba5a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:04.929486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb990f5a-97e3-4d03-98ea-2f2ff5479493 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:04.948478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:04.949751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:04.950052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:04.950318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] PATH_INFO: `/v3/projects/4cab796b97394526b8617cc56b60195c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:04.953211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cab796b97394526b8617cc56b60195c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:04.955212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:04.957007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ad5ee7fc0640eba1232160c5f8ba5a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:04.958839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ad5ee7fc0640eba1232160c5f8ba5a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:04.960122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ad5ee7fc0640eba1232160c5f8ba5a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:04.965777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:04.984365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6bf02a5c-b11c-4551-a5c8-ef9e83c72993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ad5ee7fc0640eba1232160c5f8ba5a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:05.023309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1035/2065] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:04 2022] DELETE /identity/v3/users/a1ad5ee7fc0640eba1232160c5f8ba5a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:05.025478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98375fcf-ca1a-4292-a70a-93fa6250eea1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.025835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98375fcf-ca1a-4292-a70a-93fa6250eea1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.026228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98375fcf-ca1a-4292-a70a-93fa6250eea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.061468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-98375fcf-ca1a-4292-a70a-93fa6250eea1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:05.062739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-98375fcf-ca1a-4292-a70a-93fa6250eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:05.076800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cab796b97394526b8617cc56b60195c', 'request_id': 'req-990a9cca-8d35-4cf3-b725-c5a119c515ea'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:05.093618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cab796b97394526b8617cc56b60195c', 'request_id': 'req-990a9cca-8d35-4cf3-b725-c5a119c515ea'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:05.112995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cab796b97394526b8617cc56b60195c', 'request_id': 'req-990a9cca-8d35-4cf3-b725-c5a119c515ea'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:05.144605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] The token cache is being invalidate because project 4cab796b97394526b8617cc56b60195c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:05.147063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:05.149347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-990a9cca-8d35-4cf3-b725-c5a119c515ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:05.152576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1031/2066] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:04 2022] DELETE /identity/v3/projects/4cab796b97394526b8617cc56b60195c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:05.157399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.157814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.157992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.205728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:05.208475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:05.234702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1036/2067] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:05.248409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1032/2068] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:05.252167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.252951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.253516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.266498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.268119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:05.295367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:05.296779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:05.335984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1037/2069] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:05.337502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.360754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151156a5-4657-4f2c-a652-f475048f4b96 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.372228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.372912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.373261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.373765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.375237 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:05.375848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:05.381495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:05.416855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1038/2070] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:15:05.422229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.440551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a7958-7ea5-4064-9197-f741726d2c2e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.442402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875336a7-385c-4325-8cec-18b24a0b0f9f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.448173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.451004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.451286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.451557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.455612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.456291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.456608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.456818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.457558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:05.464968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:05.473144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:05.474638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:05.511252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1033/2071] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:15:05.544612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1039/2072] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:05 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:05.548930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.564375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ad375-4a40-4bc8-a63f-bd9b21035d47 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.588131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:05.765073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.765825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.766387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.766747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.767557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:05.772522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:05.825069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1034/2073] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:05 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:05.829295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.846648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a325e8-3ef3-49f3-adef-7bf8c920710c admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.864490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.865209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.865522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.865923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.866667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:05.868537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:05.894603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1040/2074] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:05.895294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.909800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496911a4-47a0-4fe9-8632-e3e2d52f86c8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.920981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f01e4-510b-4640-9afa-038c6f096737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.921907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f01e4-510b-4640-9afa-038c6f096737 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.922185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f01e4-510b-4640-9afa-038c6f096737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.922449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f01e4-510b-4640-9afa-038c6f096737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:05.923212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f01e4-510b-4640-9afa-038c6f096737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:05.924916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f01e4-510b-4640-9afa-038c6f096737 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:05.955651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1035/2075] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:05.957991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:05.981692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529967d6-5eb0-4d24-9741-e215f66b438b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:05.990006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:05.990734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:05.991148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:05.991489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] PATH_INFO: `/v3/projects/ac9f331b740147dc9bd606ca37c3d70f/users/a141f32ac54e436c8b959e5a1145cedf/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:06.073960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9f331b740147dc9bd606ca37c3d70f, user_id=a141f32ac54e436c8b959e5a1145cedf, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:06.084699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:06.117624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1041/2076] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:05 2022] PUT /identity/v3/projects/ac9f331b740147dc9bd606ca37c3d70f/users/a141f32ac54e436c8b959e5a1145cedf/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:06.129209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:06.129512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:06.130310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:06.175712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] MFA Rules not processed for user `a141f32ac54e436c8b959e5a1145cedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:06.180322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:06.374468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1036/2077] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:06.383504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:06.387263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:06.465300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01469df7-30fb-4b02-803c-b3b4d097427b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:06.480399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0324b15-7c35-4c9d-a0e5-35d5fd08d31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:06.481097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324b15-7c35-4c9d-a0e5-35d5fd08d31b service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:06.481390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324b15-7c35-4c9d-a0e5-35d5fd08d31b service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:06.481698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324b15-7c35-4c9d-a0e5-35d5fd08d31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:06.497575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0324b15-7c35-4c9d-a0e5-35d5fd08d31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:06.499094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0324b15-7c35-4c9d-a0e5-35d5fd08d31b service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:06.524257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1042/2078] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:07.737369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:07.738859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:07.862900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f853190-1f6e-43ac-b689-ef44b4f7dd64 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:07.868623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:07.869744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:07.870127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:07.870497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] PATH_INFO: `/v3/projects/d0c12eaeea804871882252f2d18ae7e5` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:07.871879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c12eaeea804871882252f2d18ae7e5)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:07.873931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:07.919112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:07.992339 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c12eaeea804871882252f2d18ae7e5', 'request_id': 'req-43d469f7-f834-406b-aa39-764ae7ed2a29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:08.000382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c12eaeea804871882252f2d18ae7e5', 'request_id': 'req-43d469f7-f834-406b-aa39-764ae7ed2a29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:08.011780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c12eaeea804871882252f2d18ae7e5', 'request_id': 'req-43d469f7-f834-406b-aa39-764ae7ed2a29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:08.035900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] The token cache is being invalidate because project d0c12eaeea804871882252f2d18ae7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:08.036721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:08.037193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d469f7-f834-406b-aa39-764ae7ed2a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:08.039836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1037/2079] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:07 2022] DELETE /identity/v3/projects/d0c12eaeea804871882252f2d18ae7e5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:08.045832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.046373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.046373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.069174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:08.070650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:08.075481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:08.157831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1043/2080] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:08.170860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.171156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.171433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.209259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:08.210515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:08.239341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1038/2081] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:08.245015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.257606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34ea66-a68b-4eb9-a258-6cfca15572cc None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.275175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.276229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.276660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.277190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.278429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:08.278736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.280497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.319423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1044/2082] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:15:08.324011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.337870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d07001-e746-45ec-ae3d-e835e1fa2ff0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.343922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.344776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.345401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.345821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.347025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.350189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.426817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.427988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1039/2083] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:08 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:08.445410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457e3d-c658-4908-a9ad-31a8bcecc3d8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.479997 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.482351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:08.565680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978870-1aae-46a2-8fd4-3dcf4b167e12 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.570005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.570806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.571130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.571530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.574015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:08.603498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.604705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.604985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.607565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.609352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.611362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.664396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1045/2084] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:08 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:08.667358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.690119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2236ea-84a1-4a97-8065-9fa8b73acbb6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.706209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.706942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.707419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.708308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.709119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.725529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.726617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.739162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.744624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1046/2085] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:08.749853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.751839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1040/2086] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:15:08.783258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658074-817c-40c5-b3aa-b0e529e12c00 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.801008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8512fd1-ad53-44f9-9464-201b47f15f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.801789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8512fd1-ad53-44f9-9464-201b47f15f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.803074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8512fd1-ad53-44f9-9464-201b47f15f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.803370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8512fd1-ad53-44f9-9464-201b47f15f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.804778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8512fd1-ad53-44f9-9464-201b47f15f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.812001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8512fd1-ad53-44f9-9464-201b47f15f75 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.856101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:08.859149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1047/2087] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:08.867855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034afdb5-6878-4953-b05d-a927e7a7067f service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:08.878917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:08.879858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.880136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.880407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] PATH_INFO: `/v3/projects/ec25c6cf6a6948e7834130300501e195/users/b7b99191235349a2b6fc26cf1ff20f76/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:08.930292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec25c6cf6a6948e7834130300501e195, user_id=b7b99191235349a2b6fc26cf1ff20f76, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:08.934410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:08.969988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1041/2088] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:08 2022] PUT /identity/v3/projects/ec25c6cf6a6948e7834130300501e195/users/b7b99191235349a2b6fc26cf1ff20f76/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:08.982841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:08.983361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:08.983740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.091087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] MFA Rules not processed for user `b7b99191235349a2b6fc26cf1ff20f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:09.095415 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:09.255816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:09.281976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1048/2089] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:09.285711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:09.292777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:09.398644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686afea6-a69a-4680-899e-8ff159b0e74d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:09.404950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:09.405667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:09.406195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:09.406630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.407503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:09.409899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:09.485921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1042/2090] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:09 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:09.491855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:09.518795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd950cb-5022-4c3e-bb22-8b54ef3bfbe1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:09.605697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:09.609363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:09.609717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:09.610709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.611515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:09.613706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:09.649379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1049/2091] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:09 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:09.657449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:09.671149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f738-9fce-4531-8072-c497c8ac280b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:09.676695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:09.679098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:09.680055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:09.680606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.681629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:09.684128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:09.714405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1043/2092] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:09.718552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:09.733760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b63c81-cb71-41f7-80b7-9153d7088e59 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:09.743510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ceeb6-deed-4ea3-96a1-e8e997271dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:09.744791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ceeb6-deed-4ea3-96a1-e8e997271dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:09.745076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ceeb6-deed-4ea3-96a1-e8e997271dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:09.745459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ceeb6-deed-4ea3-96a1-e8e997271dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.747714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ceeb6-deed-4ea3-96a1-e8e997271dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:09.751125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ceeb6-deed-4ea3-96a1-e8e997271dbe admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:09.807492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1050/2093] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:09.814462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:09.828254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f36b-938e-4029-b4be-20060a27fa0c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:09.835087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:09.836342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:09.837312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:09.838111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] PATH_INFO: `/v3/projects/211f0c2db5e3485ab17c73299382c17f/users/e08e973ed60944e58b62e0548002b934/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.872535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211f0c2db5e3485ab17c73299382c17f, user_id=e08e973ed60944e58b62e0548002b934, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:09.876969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:09.929026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1044/2094] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:09 2022] PUT /identity/v3/projects/211f0c2db5e3485ab17c73299382c17f/users/e08e973ed60944e58b62e0548002b934/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:09.929537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:09.929829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:09.930164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:09.986252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] MFA Rules not processed for user `e08e973ed60944e58b62e0548002b934`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:09.987863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:10.179678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:10.183428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1051/2095] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:10.333670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6954bc-742b-4fe0-b129-c6bb39e7bbb9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:10.346396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:10.347181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:10.347630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:10.348126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:10.349002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:10.351204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:10.419792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1045/2096] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:10 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:15:10.424278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:10.440941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fe823-cf8d-480e-b7eb-3ad9f38a2909 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:10.628408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:10.629108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:10.629407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:10.629819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:10.631238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:10.635396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:10.658033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:10.697249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1052/2097] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:10 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:10.702501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:10.731009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc4c3b-8248-4202-9e4c-122a3cf0a141 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:10.747261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:10.750463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:10.752654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:10.753294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:10.756004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:10.765259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:10.815176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1046/2098] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:10.818037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:10.835773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294caf45-4b74-41fa-9be3-878c296d1aa5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:10.855038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:10.869922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:10.871218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:10.872032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] PATH_INFO: `/v3/projects/4f7925fc0f754f3d84459564333bd9d5/users/f4a6a433f7d84010ae8059ef074fc209/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:10.937807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7925fc0f754f3d84459564333bd9d5, user_id=f4a6a433f7d84010ae8059ef074fc209, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:10.943563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:10.987754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1053/2099] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:10 2022] PUT /identity/v3/projects/4f7925fc0f754f3d84459564333bd9d5/users/f4a6a433f7d84010ae8059ef074fc209/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:10.988954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:11.018095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84be3-e5c2-4377-878d-8ff06caac428 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:11.094902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:11.197497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb145336-65fe-434b-9204-a90dccd9b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:11.198604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145336-65fe-434b-9204-a90dccd9b6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:11.200099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145336-65fe-434b-9204-a90dccd9b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:11.200528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145336-65fe-434b-9204-a90dccd9b6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:11.201546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb145336-65fe-434b-9204-a90dccd9b6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:11.204193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb145336-65fe-434b-9204-a90dccd9b6f7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:11.246817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:11.248420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1047/2100] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:15:11.270583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae43f5-fccb-47bc-81a4-64bffaa2e5d6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:11.279577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:11.294162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:11.294162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:11.294162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] PATH_INFO: `/v3/projects/4f7925fc0f754f3d84459564333bd9d5/users/f4a6a433f7d84010ae8059ef074fc209/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:11.301837 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7925fc0f754f3d84459564333bd9d5, user_id=f4a6a433f7d84010ae8059ef074fc209, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:11.319082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:11.352689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1054/2101] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:11 2022] PUT /identity/v3/projects/4f7925fc0f754f3d84459564333bd9d5/users/f4a6a433f7d84010ae8059ef074fc209/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:11.372835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f05f-354a-4424-8313-58cbc813b9ca None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:11.373346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f05f-354a-4424-8313-58cbc813b9ca None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:11.375398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f05f-354a-4424-8313-58cbc813b9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:11.438774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bd64f05f-354a-4424-8313-58cbc813b9ca None None] MFA Rules not processed for user `f4a6a433f7d84010ae8059ef074fc209`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:11.440797 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bd64f05f-354a-4424-8313-58cbc813b9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:11.563130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1048/2102] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:11.579609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:11.665098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33cc6-792b-46be-b810-60f1a620ea19 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:11.669566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4242c-a39b-48e7-a73f-f4b1e361fee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:11.670232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4242c-a39b-48e7-a73f-f4b1e361fee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:11.670516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4242c-a39b-48e7-a73f-f4b1e361fee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:11.670786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4242c-a39b-48e7-a73f-f4b1e361fee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:11.772839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4242c-a39b-48e7-a73f-f4b1e361fee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:11.774931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4242c-a39b-48e7-a73f-f4b1e361fee2 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:11.802384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1055/2103] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:12.049504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbd5e-c23e-41a6-9d07-4e318e9bcf3e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:12.051217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbd5e-c23e-41a6-9d07-4e318e9bcf3e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:12.051825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbd5e-c23e-41a6-9d07-4e318e9bcf3e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:12.055933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1049/2104] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:15:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:15:12.116009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:12.116503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:12.117070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:12.122650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbd5e-c23e-41a6-9d07-4e318e9bcf3e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:12.128860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5e3cbd5e-c23e-41a6-9d07-4e318e9bcf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:12.206427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:12.208420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:12.333672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbd5e-c23e-41a6-9d07-4e318e9bcf3e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:12.344124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:12.345259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:12.345691 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:12.346124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] PATH_INFO: `/v3/users/d0db4cc91baa4721b5c6d750eeddf9bf` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:12.347753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0db4cc91baa4721b5c6d750eeddf9bf)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:12.350060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:12.406954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1056/2105] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:12.422433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:12.424113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:12.467204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:12.478963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba51e6-1ddb-4337-b4ff-2410fb794011 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:12.482957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0db4cc91baa4721b5c6d750eeddf9bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:12.514871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:12.522136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c32c2-1a53-4066-9d28-f940ec58a98b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:12.526306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c32c2-1a53-4066-9d28-f940ec58a98b service placement] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:12.528147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c32c2-1a53-4066-9d28-f940ec58a98b service placement] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:12.528691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c32c2-1a53-4066-9d28-f940ec58a98b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:12.550398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0db4cc91baa4721b5c6d750eeddf9bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:12.552932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0db4cc91baa4721b5c6d750eeddf9bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:12.555280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0db4cc91baa4721b5c6d750eeddf9bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:12.558735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c32c2-1a53-4066-9d28-f940ec58a98b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:12.560525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c32c2-1a53-4066-9d28-f940ec58a98b service placement] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:12.583633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0db4cc91baa4721b5c6d750eeddf9bf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:12.588099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1057/2106] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:12.594602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:12.595177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:12.595651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:12.647677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1050/2107] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:12 2022] DELETE /identity/v3/users/d0db4cc91baa4721b5c6d750eeddf9bf => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:12.662267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] MFA Rules not processed for user `36f087484fc04062b91829bb5cbd1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:12.664321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:12.751607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1058/2108] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:12.765372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:12.767151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:12.867037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081345-3bfd-4161-b87a-2a07ad4ada4c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:12.872260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:12.872926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:12.873206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:12.873509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:12.875819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:12.933257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:12.934895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:13.025811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.031738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e61e9-8b62-496e-be67-ed77a32288f0 service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:13.052045 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1051/2109] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:13.052908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca752-08cf-44c4-8a76-2954578479b5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:13.059545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:13.060573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.061031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.061337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] PATH_INFO: `/v3/projects/3983674ece774d72ba495a54862e43f8` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.062895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3983674ece774d72ba495a54862e43f8)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.065571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:13.181275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3983674ece774d72ba495a54862e43f8', 'request_id': 'req-0fa176b6-09c2-46b3-aebd-8477a04338c2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:13.202954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3983674ece774d72ba495a54862e43f8', 'request_id': 'req-0fa176b6-09c2-46b3-aebd-8477a04338c2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:13.210640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3983674ece774d72ba495a54862e43f8', 'request_id': 'req-0fa176b6-09c2-46b3-aebd-8477a04338c2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:13.227764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.228085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.228629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.243472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] The token cache is being invalidate because project 3983674ece774d72ba495a54862e43f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:13.244171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:13.245034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0fa176b6-09c2-46b3-aebd-8477a04338c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:13.247432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1059/2110] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:12 2022] DELETE /identity/v3/projects/3983674ece774d72ba495a54862e43f8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:13.252785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:13.254134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:13.254952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89707d7e-e42f-4230-8adc-5af7e3474ae6 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.255493 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89707d7e-e42f-4230-8adc-5af7e3474ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.255982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89707d7e-e42f-4230-8adc-5af7e3474ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.278106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:13.294284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-89707d7e-e42f-4230-8adc-5af7e3474ae6 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:13.295795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-89707d7e-e42f-4230-8adc-5af7e3474ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:13.364813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1052/2111] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:13.385003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:13.386935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:13.409380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1060/2112] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:13.412479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.414548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.415004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.451355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:13.462379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:13.463183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:13.472691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1061/2113] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:13.479197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:13.492197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef080e-9ddd-4dd1-9349-32d21887cb65 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:13.498262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:13.499218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.499809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.500229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.501196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:13.501809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.504300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:13.521796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1062/2114] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:15:13.528229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:13.547306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00d501-66fc-475e-8c7d-1593a1ba1557 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:13.551129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b6da-0c05-44f2-8c86-a73c0e7a3ab1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:13.553665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:13.554598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.555023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.555423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.557404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:13.558099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.558378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.558651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.559364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.562453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:13.585121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.588063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:13.608053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1053/2115] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:15:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:15:13.614085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1063/2116] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:13 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:13.614207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:13.627629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a0524-a2f7-4465-99a6-0ef0ff4fb261 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:13.840827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:13.841785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.844298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.844593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.848345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.862792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:13.930190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1054/2117] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:13 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:13.932456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:13.967655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d228-4592-402e-aaac-477249144d45 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:13.975558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:13.976709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:13.977212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:13.979558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:13.980691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:13.984411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:14.004936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1064/2118] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:14.005541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:14.035690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c0a8-d7b2-4adc-8cf5-b10fc8f23e59 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:14.069616 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b1561-c933-4112-af85-f53252e315df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:14.070346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1561-c933-4112-af85-f53252e315df admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:14.071400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1561-c933-4112-af85-f53252e315df admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:14.071683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1561-c933-4112-af85-f53252e315df admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:14.072358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b1561-c933-4112-af85-f53252e315df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:14.074094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b1561-c933-4112-af85-f53252e315df admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:14.093785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1055/2119] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:14.096528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:14.119241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b1561-c933-4112-af85-f53252e315df admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:14.125749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-095b1561-c933-4112-af85-f53252e315df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:14.132657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade2b1-dacf-4d7b-88d7-f0e10a2d563b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:14.148362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9aa45-93da-484f-aba0-b8249dcd62af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:14.149639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9aa45-93da-484f-aba0-b8249dcd62af admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:14.150268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9aa45-93da-484f-aba0-b8249dcd62af admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:14.150713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9aa45-93da-484f-aba0-b8249dcd62af admin admin] PATH_INFO: `/v3/projects/b76b12f460ee49ea8b80da53da1ba9a7/users/00e5f97f0cfd48b59a8e5dc444cee670/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:14.195317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9aa45-93da-484f-aba0-b8249dcd62af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76b12f460ee49ea8b80da53da1ba9a7, user_id=00e5f97f0cfd48b59a8e5dc444cee670, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:14.199293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9aa45-93da-484f-aba0-b8249dcd62af admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:14.232299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1065/2120] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:14 2022] PUT /identity/v3/projects/b76b12f460ee49ea8b80da53da1ba9a7/users/00e5f97f0cfd48b59a8e5dc444cee670/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:14.234333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:14.234687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:14.235014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:14.256936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:14.258401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:14.272466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b1561-c933-4112-af85-f53252e315df admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:14.342189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1066/2121] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:14.353955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:14.356909 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:14.374612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:14.375381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:14.375685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:14.376128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:14.378387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:14.392876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:14.417506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:14.448403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2327a53-43b4-4cdf-b6a2-1b3e74ab6d73 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:14.453506 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:14.454240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:14.454617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:14.454983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:14.468097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:14.469749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:14.481150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1067/2122] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:14.506570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:14.509038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:14.525681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1056/2123] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:16.138794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:16.141091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:16.222795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f1da-1af0-4487-b498-a8aa3ecf7dfe service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:16.236158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:16.236844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:16.237126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:16.237402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:16.248738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:16.455621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:16.458319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f87aa-df57-48a9-8ff4-a6f371ba792d service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:16.472154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1068/2124] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:20.841007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:20.843475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:20.860299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f418059-8dff-4ca2-8757-5eb2653709b6 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:20.867009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:20.868308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:20.868674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:20.869075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] PATH_INFO: `/v3/users/a141f32ac54e436c8b959e5a1145cedf` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:20.870750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a141f32ac54e436c8b959e5a1145cedf)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:20.873111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:20.964510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a141f32ac54e436c8b959e5a1145cedf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:20.993250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a141f32ac54e436c8b959e5a1145cedf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:20.994080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a141f32ac54e436c8b959e5a1145cedf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:20.994914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a141f32ac54e436c8b959e5a1145cedf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.005318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a141f32ac54e436c8b959e5a1145cedf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.040765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1057/2125] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:20 2022] DELETE /identity/v3/users/a141f32ac54e436c8b959e5a1145cedf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:21.045477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:21.046420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:21.046420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:21.108724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:21.113942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:21.326973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1069/2126] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:21.341673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:21.344190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:21.544814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d8ea3-1ad4-4218-bfdc-7d3f57ba9279 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:21.549938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e665d5-fd4b-4722-a495-5273acaf5a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:21.550985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e665d5-fd4b-4722-a495-5273acaf5a2b service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:21.551643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e665d5-fd4b-4722-a495-5273acaf5a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:21.552130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e665d5-fd4b-4722-a495-5273acaf5a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:21.573071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e665d5-fd4b-4722-a495-5273acaf5a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:21.574879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e665d5-fd4b-4722-a495-5273acaf5a2b service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:21.582686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:21.584357 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:21.623478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6cac5-74a8-4956-ae40-f572ac5a5211 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:21.640167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1058/2127] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:21.643291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:21.644606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:21.645124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:21.645528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] PATH_INFO: `/v3/users/b7b99191235349a2b6fc26cf1ff20f76` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:21.648007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b99191235349a2b6fc26cf1ff20f76)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:21.650258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:21.762655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b99191235349a2b6fc26cf1ff20f76'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.792309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:21.795051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b99191235349a2b6fc26cf1ff20f76'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.800215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b99191235349a2b6fc26cf1ff20f76'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.801824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b99191235349a2b6fc26cf1ff20f76'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.823725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b99191235349a2b6fc26cf1ff20f76'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:21.856393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:21.856936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:21.857312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:21.859331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1070/2128] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:21 2022] DELETE /identity/v3/users/b7b99191235349a2b6fc26cf1ff20f76 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:21.900163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:21.904195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:21.962856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:22.071714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1059/2129] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:22.108021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:22.110407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:22.270273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7b8da-1e5c-495a-a9ee-f49a4520f0f9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:22.275628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6556f-87e2-4e74-a478-503b3eff504f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:22.276917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6556f-87e2-4e74-a478-503b3eff504f service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:22.278669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6556f-87e2-4e74-a478-503b3eff504f service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:22.279550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6556f-87e2-4e74-a478-503b3eff504f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:22.312647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6556f-87e2-4e74-a478-503b3eff504f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:22.314865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6556f-87e2-4e74-a478-503b3eff504f service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:22.350915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1071/2130] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:22.553321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:22.555230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:22.581475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616af06-704e-4c59-b15b-9ed14a51ee5b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:22.597856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:22.600143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:22.602193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:22.603552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] PATH_INFO: `/v3/projects/ac9f331b740147dc9bd606ca37c3d70f` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:22.606656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9f331b740147dc9bd606ca37c3d70f)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:22.610752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:22.782850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9f331b740147dc9bd606ca37c3d70f', 'request_id': 'req-ed469d44-c485-44f6-8c5e-c45a4399e748'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:22.798968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9f331b740147dc9bd606ca37c3d70f', 'request_id': 'req-ed469d44-c485-44f6-8c5e-c45a4399e748'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:22.843973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9f331b740147dc9bd606ca37c3d70f', 'request_id': 'req-ed469d44-c485-44f6-8c5e-c45a4399e748'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:22.918667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] The token cache is being invalidate because project ac9f331b740147dc9bd606ca37c3d70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:22.919239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:22.927650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed469d44-c485-44f6-8c5e-c45a4399e748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:22.929810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1060/2131] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:22 2022] DELETE /identity/v3/projects/ac9f331b740147dc9bd606ca37c3d70f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:22.936024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:22.936314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:22.936595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:22.980963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:22.983669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:23.123757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1072/2132] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:23.131653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.132168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.132450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.188150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:23.189530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:23.219903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1061/2133] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:23.224614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.239427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ca5b1-92ce-4581-9b3c-93703caac42a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:23.252288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:23.253296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.253745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.254181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.255096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:23.255567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:23.257371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:23.286934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1073/2134] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:15:23.291728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.308000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d743ea-0ba9-471b-b813-a7d38872db8b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:23.324552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:23.325275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.325564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.325839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.326706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:23.328655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:23.394563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1062/2135] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:23 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:23.395866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.414188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca2eb-8412-4c44-ab55-fbaacf256bc4 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:23.456592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.459486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:23.544969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:23.546102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.546541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.547472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.548362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:23.551751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:23.584829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:23.595140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1074/2136] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:23 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:15:23.598496 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.624523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c25d01-f7f9-4299-b54b-0d13c66c2476 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:23.632468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57de558-0ac2-4e36-895b-092f69ff414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:23.633756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57de558-0ac2-4e36-895b-092f69ff414e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.633978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57de558-0ac2-4e36-895b-092f69ff414e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.647686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57de558-0ac2-4e36-895b-092f69ff414e admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.658198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57de558-0ac2-4e36-895b-092f69ff414e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:23.662674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57de558-0ac2-4e36-895b-092f69ff414e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:23.685954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821c68-a59a-4713-9052-371530e3bd13 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:23.700650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:23.701665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1075/2137] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:23.703167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.705658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:23.705959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.706239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] PATH_INFO: `/v3/projects/ec25c6cf6a6948e7834130300501e195` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.706452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:23.706850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:23.712216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec25c6cf6a6948e7834130300501e195)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:23.717092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:23.766504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:23.770880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] MFA Rules not processed for user `00e5f97f0cfd48b59a8e5dc444cee670`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:23.773114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:23.818808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec25c6cf6a6948e7834130300501e195', 'request_id': 'req-e76e68a1-4011-4844-8a12-bc37a3c37b00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:23.832930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec25c6cf6a6948e7834130300501e195', 'request_id': 'req-e76e68a1-4011-4844-8a12-bc37a3c37b00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:23.842477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec25c6cf6a6948e7834130300501e195', 'request_id': 'req-e76e68a1-4011-4844-8a12-bc37a3c37b00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:23.871511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] The token cache is being invalidate because project ec25c6cf6a6948e7834130300501e195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:23.872212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:23.873278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:23.875283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1063/2138] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:23 2022] DELETE /identity/v3/projects/ec25c6cf6a6948e7834130300501e195 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:23.876298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.879975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:23.889035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1076/2139] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:23.890182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:23.908526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f029445-a027-4e3f-a4b5-bc552e589c08 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:24.028434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:24.029489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:24.029756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:24.030028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] PATH_INFO: `/v3/users/e08e973ed60944e58b62e0548002b934` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:24.032502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08e973ed60944e58b62e0548002b934)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:24.035447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:24.067280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e68a1-4011-4844-8a12-bc37a3c37b00 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:24.085348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:24.086487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:24.086938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:24.087257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:24.088051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:24.090344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:24.110995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1064/2140] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:24.112125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:24.115898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:24.145972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08e973ed60944e58b62e0548002b934'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:24.179055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08e973ed60944e58b62e0548002b934'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:24.181889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08e973ed60944e58b62e0548002b934'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:24.182884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08e973ed60944e58b62e0548002b934'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:24.199880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08e973ed60944e58b62e0548002b934'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:24.220754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:24.234792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1077/2141] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:23 2022] DELETE /identity/v3/users/e08e973ed60944e58b62e0548002b934 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:24.234792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:24.238218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:24.335101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef4ad9-d07a-44f9-b6b4-d1ad88ffceac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:24.421128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadaa71-c024-4573-9cd5-61f9d77c6e93 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:24.439862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f3ba-ee54-446a-aad9-d2482ce6ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:24.443029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f3ba-ee54-446a-aad9-d2482ce6ef1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:24.446033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f3ba-ee54-446a-aad9-d2482ce6ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:24.446033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f3ba-ee54-446a-aad9-d2482ce6ef1b admin admin] PATH_INFO: `/v3/projects/52f6f80ec8f84d81915c87a77c8ebe14/users/34a67e50fe91465391ee1afa15ed433a/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:24.456534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:24.546997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f3ba-ee54-446a-aad9-d2482ce6ef1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f6f80ec8f84d81915c87a77c8ebe14, user_id=34a67e50fe91465391ee1afa15ed433a, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:24.547386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:24.548659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:24.549007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:24.549410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:24.551425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f3ba-ee54-446a-aad9-d2482ce6ef1b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:24.551664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:24.577801 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1078/2142] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:24 2022] PUT /identity/v3/projects/52f6f80ec8f84d81915c87a77c8ebe14/users/34a67e50fe91465391ee1afa15ed433a/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:24.583298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:24.584323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:24.585300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:24.628580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:24.638065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:24.692088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:24.695295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:24.710976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1065/2143] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:24.749563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1079/2144] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:24.764854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:24.775684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:24.824088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:24.827769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:24.877082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b273b05-7a95-46e3-bbc7-de2050fe1b25 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:24.884049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:24.884932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:24.885397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:24.888482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] PATH_INFO: `/v3/projects/211f0c2db5e3485ab17c73299382c17f` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:24.888792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] RBAC: Authorizing `identity:delete_project(project_id=211f0c2db5e3485ab17c73299382c17f)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:24.890911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:24.933954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c34eb5-fb97-4bc8-ac68-14971b6c7ca5 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:24.980936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211f0c2db5e3485ab17c73299382c17f', 'request_id': 'req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:24.994619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211f0c2db5e3485ab17c73299382c17f', 'request_id': 'req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.005252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211f0c2db5e3485ab17c73299382c17f', 'request_id': 'req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.027712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] The token cache is being invalidate because project 211f0c2db5e3485ab17c73299382c17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:25.028194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.029605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.036515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1080/2145] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:24 2022] DELETE /identity/v3/projects/211f0c2db5e3485ab17c73299382c17f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:25.037091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:25.039768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:25.049910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:25.050507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:25.050790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:25.051060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:25.053793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:25.056527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:25.096413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:25.098508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:25.149632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1066/2146] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:25.227412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0375f-6425-4a5a-82b5-aa4ffb9f67da admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:25.238996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:25.239929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:25.240209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:25.240497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] PATH_INFO: `/v3/users/f4a6a433f7d84010ae8059ef074fc209` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:25.243310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a6a433f7d84010ae8059ef074fc209)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:25.245557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:25.369787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a6a433f7d84010ae8059ef074fc209'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.385220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a6a433f7d84010ae8059ef074fc209'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.385462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a6a433f7d84010ae8059ef074fc209'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.386226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a6a433f7d84010ae8059ef074fc209'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.402283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-41d6c654-f963-4dcc-a598-1afb1d84b02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a6a433f7d84010ae8059ef074fc209'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:25.450233 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1081/2147] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:25 2022] DELETE /identity/v3/users/f4a6a433f7d84010ae8059ef074fc209 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:26.028120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:26.038849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ded254-5983-4d92-adba-2fb642f975ee service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:26.207259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:26.281407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:26.281407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:26.281407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:26.281407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] PATH_INFO: `/v3/projects/4f7925fc0f754f3d84459564333bd9d5` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:26.284230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7925fc0f754f3d84459564333bd9d5)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:26.290277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:26.393938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7925fc0f754f3d84459564333bd9d5', 'request_id': 'req-f53a243b-7060-4c06-a153-94b1422f7fd4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:26.408174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7925fc0f754f3d84459564333bd9d5', 'request_id': 'req-f53a243b-7060-4c06-a153-94b1422f7fd4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:26.418167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7925fc0f754f3d84459564333bd9d5', 'request_id': 'req-f53a243b-7060-4c06-a153-94b1422f7fd4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:26.436714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] The token cache is being invalidate because project 4f7925fc0f754f3d84459564333bd9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:26.437571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:26.438565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f53a243b-7060-4c06-a153-94b1422f7fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:26.440860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1067/2148] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:26 2022] DELETE /identity/v3/projects/4f7925fc0f754f3d84459564333bd9d5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:26.447428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:26.449036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:26.449696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:26.474356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:26.476416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:26.609003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1082/2149] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:26.618224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:26.618760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:26.619193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:26.672131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:26.682822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:26.706930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1068/2150] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:26.715878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:26.731592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44a4fe-c6a3-4314-9d32-fb057423f02d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:26.740266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:26.741692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:26.742279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:26.742980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:26.744990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:26.745601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:26.747819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:26.769141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1083/2151] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:15:26.773432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:26.784135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f09557-b0f6-4d5f-91b1-2f114f499cbb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:26.804094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:26.804920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:26.805290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:26.805581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:26.807466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:26.819870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:26.892494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1069/2152] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:26 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:26.896682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:26.913403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c0da-c81c-4b91-a22e-c569be37bab2 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:26.953931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:27.201431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:27.202186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:27.202464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:27.202732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:27.203489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:27.205621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:27.242104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1084/2153] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:26 2022] POST /identity/v3/users => generated 287 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:27.246210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:27.261518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d937-3ef2-440f-8dd5-3f69cd24581c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:27.298491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:27.299210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:27.299489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:27.299764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:27.300515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:27.302188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:27.356005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1070/2154] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:27.357179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:27.387183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed341f89-2014-48b0-b651-a413c19085c1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:27.398243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db36582-3efe-4576-931f-8a22244004b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:27.399195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db36582-3efe-4576-931f-8a22244004b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:27.399474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db36582-3efe-4576-931f-8a22244004b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:27.399754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db36582-3efe-4576-931f-8a22244004b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:27.401686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db36582-3efe-4576-931f-8a22244004b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:27.403307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db36582-3efe-4576-931f-8a22244004b9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:27.430983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1085/2155] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:15:27.435156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:27.451267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aea13-95d3-4c49-88a9-4ae63b247af3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:27.470900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:27.472056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:27.478193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:27.478746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] PATH_INFO: `/v3/projects/b652f5cba5aa4c0f8ba4b06cf9a8c812/users/3fa091a29c3d4dd29e328d0036c4c744/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:27.526199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b652f5cba5aa4c0f8ba4b06cf9a8c812, user_id=3fa091a29c3d4dd29e328d0036c4c744, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:27.528899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:27.555003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1071/2156] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:27 2022] PUT /identity/v3/projects/b652f5cba5aa4c0f8ba4b06cf9a8c812/users/3fa091a29c3d4dd29e328d0036c4c744/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:27.568399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bc23-35a6-4e96-bbfe-ac041bc3084a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:27.569036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bc23-35a6-4e96-bbfe-ac041bc3084a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:27.569036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bc23-35a6-4e96-bbfe-ac041bc3084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:27.660794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e890bc23-35a6-4e96-bbfe-ac041bc3084a None None] MFA Rules not processed for user `3fa091a29c3d4dd29e328d0036c4c744`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:27.667686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e890bc23-35a6-4e96-bbfe-ac041bc3084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:27.902268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1086/2157] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:27.912224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:27.914940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:28.166310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847490c-42b0-45d3-9b97-2a67fa0d3103 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:28.173767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:28.174978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:28.175453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:28.175967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:28.206284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:28.222345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:28.262865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1072/2158] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:28.316392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27d21-5819-4f31-bcd7-f70ad08f8e24 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:28.323443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27d21-5819-4f31-bcd7-f70ad08f8e24 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:28.323990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27d21-5819-4f31-bcd7-f70ad08f8e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:28.349314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:28.363027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-91a27d21-5819-4f31-bcd7-f70ad08f8e24 None None] MFA Rules not processed for user `00e5f97f0cfd48b59a8e5dc444cee670`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:28.365197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-91a27d21-5819-4f31-bcd7-f70ad08f8e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:28.379978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:28.480980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f167-1cb7-4fc5-a51e-bacdafdcdb56 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:28.506317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:28.507039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:28.507319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:28.507595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] PATH_INFO: `/v3/users/3fa091a29c3d4dd29e328d0036c4c744` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:28.512967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa091a29c3d4dd29e328d0036c4c744)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:28.516425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:28.541439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1087/2159] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:28.631566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa091a29c3d4dd29e328d0036c4c744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:28.663248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa091a29c3d4dd29e328d0036c4c744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:28.664094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa091a29c3d4dd29e328d0036c4c744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:28.666440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa091a29c3d4dd29e328d0036c4c744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:28.686557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa091a29c3d4dd29e328d0036c4c744'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:28.708662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1073/2160] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:28 2022] DELETE /identity/v3/users/3fa091a29c3d4dd29e328d0036c4c744 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:28.711474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:28.712750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:28.713247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:28.741196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:28.758094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:28.786240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:28.898375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1088/2161] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:15:28.908814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:28.912130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:29.082994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f207-84da-441b-a1f8-735b1e43a333 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:29.090910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b348d0c-ebcd-49c4-8ad4-6aefe4134a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:29.091709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b348d0c-ebcd-49c4-8ad4-6aefe4134a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:29.092090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b348d0c-ebcd-49c4-8ad4-6aefe4134a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:29.092452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b348d0c-ebcd-49c4-8ad4-6aefe4134a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:29.108250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b348d0c-ebcd-49c4-8ad4-6aefe4134a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:29.110051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b348d0c-ebcd-49c4-8ad4-6aefe4134a0e service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:29.123988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1074/2162] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:30.335980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:30.338433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:30.368358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552b83a-42b3-4856-910a-84e78b0fc3ba None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:30.381576 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:30.382715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:30.382846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:30.383212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] PATH_INFO: `/v3/projects/b652f5cba5aa4c0f8ba4b06cf9a8c812` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:30.392737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b652f5cba5aa4c0f8ba4b06cf9a8c812)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:30.394871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:30.579394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b652f5cba5aa4c0f8ba4b06cf9a8c812', 'request_id': 'req-c7d2beef-22a2-472c-be62-d33404e0adae'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:30.602619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b652f5cba5aa4c0f8ba4b06cf9a8c812', 'request_id': 'req-c7d2beef-22a2-472c-be62-d33404e0adae'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:30.626382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b652f5cba5aa4c0f8ba4b06cf9a8c812', 'request_id': 'req-c7d2beef-22a2-472c-be62-d33404e0adae'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:30.656733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] The token cache is being invalidate because project b652f5cba5aa4c0f8ba4b06cf9a8c812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:30.657029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:30.657721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c7d2beef-22a2-472c-be62-d33404e0adae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:30.662982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1089/2163] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:30 2022] DELETE /identity/v3/projects/b652f5cba5aa4c0f8ba4b06cf9a8c812 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:30.668509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:30.669412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:30.669998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:30.711744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:30.714837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:30.789462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:30.843681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1075/2164] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:30.853126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:30.853126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:30.853465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:30.894128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:30.895401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:30.925842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1090/2165] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:30.928502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:30.947588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815a8e-3cd3-42dc-83e3-0003962ea5b4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:30.975040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:30.975733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:30.976015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:30.976289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:30.979855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:30.980179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:30.986239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:31.030118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1076/2166] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:15:31.031750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:31.050479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31d62-ec29-4ebd-817d-99b1ea5a2e42 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:31.067248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:31.067937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:31.068211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:31.068481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:31.069375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:31.071511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:31.184301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1091/2167] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:31 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:31.186053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:31.205800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672477-bb25-41ef-9206-ab5d77f40532 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:31.493895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:31.494626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:31.494913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:31.495190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:31.505443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:31.513848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:31.603720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1077/2168] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:31 2022] POST /identity/v3/users => generated 292 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:31.608181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:31.634507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28910cc-2c91-4101-a5f7-a2e1d6ed0719 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:31.652373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:31.654659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:31.655108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:31.655520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:31.656895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:31.659823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:31.677975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1092/2169] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:31.685445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:31.723646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93d10-31f8-4fc0-bb84-afd8494f6530 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:31.737578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420100-b5d2-4c8e-96c0-12a54cc0b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:31.738869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420100-b5d2-4c8e-96c0-12a54cc0b5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:31.739152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420100-b5d2-4c8e-96c0-12a54cc0b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:31.739428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420100-b5d2-4c8e-96c0-12a54cc0b5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:31.740392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c420100-b5d2-4c8e-96c0-12a54cc0b5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:31.742134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c420100-b5d2-4c8e-96c0-12a54cc0b5fe admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:31.757412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1078/2170] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:31.762686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:31.780846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404d9c4-2582-496d-863a-85c3b5073095 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:31.789589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:31.790643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:31.791002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:31.791817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] PATH_INFO: `/v3/projects/8b978c3e29c54f5dbad3a250a13fd9dd/users/f62ce6905cd64311ae6c2aa966d63a6a/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:31.829553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b978c3e29c54f5dbad3a250a13fd9dd, user_id=f62ce6905cd64311ae6c2aa966d63a6a, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:31.834625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:31.883785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1093/2171] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:31 2022] PUT /identity/v3/projects/8b978c3e29c54f5dbad3a250a13fd9dd/users/f62ce6905cd64311ae6c2aa966d63a6a/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:31.889695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb5f8-4800-4e56-ab01-d54e1ac55968 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:31.891129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb5f8-4800-4e56-ab01-d54e1ac55968 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:31.891751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb5f8-4800-4e56-ab01-d54e1ac55968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:31.960469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-655eb5f8-4800-4e56-ab01-d54e1ac55968 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:31.963190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-655eb5f8-4800-4e56-ab01-d54e1ac55968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:32.197450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1079/2172] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:32.205117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:32.206878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:32.387386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:32.421996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c784b-f7cb-4a73-9d1d-fdfa8216e73e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:32.428785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:32.429516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:32.429794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:32.430133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:32.444559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:32.447131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:32.460862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1094/2173] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:34.630030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ed71e-9e47-4f71-a353-97b1005b9cd9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:34.631362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ed71e-9e47-4f71-a353-97b1005b9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:34.631864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ed71e-9e47-4f71-a353-97b1005b9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:34.705652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bc4ed71e-9e47-4f71-a353-97b1005b9cd9 None None] MFA Rules not processed for user `f62ce6905cd64311ae6c2aa966d63a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:34.711249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bc4ed71e-9e47-4f71-a353-97b1005b9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:34.784420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:34.930279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1080/2174] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:34.939820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:34.941346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:35.069242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd82ad-93d3-45c1-bdf7-fba519d730ae service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:35.083104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6100a-6583-4357-880f-f5ab2364a2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:35.084131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6100a-6583-4357-880f-f5ab2364a2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:35.085681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6100a-6583-4357-880f-f5ab2364a2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:35.086588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6100a-6583-4357-880f-f5ab2364a2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:35.109674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6100a-6583-4357-880f-f5ab2364a2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:35.113560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6100a-6583-4357-880f-f5ab2364a2c9 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:35.149041 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1095/2175] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:37.082821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21afc43-59c0-400c-a4cd-f57e09343f89 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.083442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21afc43-59c0-400c-a4cd-f57e09343f89 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.083442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21afc43-59c0-400c-a4cd-f57e09343f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.109978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b21afc43-59c0-400c-a4cd-f57e09343f89 None None] MFA Rules not processed for user `f62ce6905cd64311ae6c2aa966d63a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:37.111210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b21afc43-59c0-400c-a4cd-f57e09343f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:37.133076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1081/2176] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:15:37.182131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.183216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.183216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.232447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.232734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.232928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] MFA Rules not processed for user `34a67e50fe91465391ee1afa15ed433a`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:37.233066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.234715 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:37.266970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] MFA Rules not processed for user `883a1f25631d453abbbdf55e2aa85b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:37.272410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:37.370637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1082/2177] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:37.410441 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1096/2178] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:37.411808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:37.413439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:37.438505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293c5d7-24d5-4e55-ae47-84239d5fa69a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:37.445361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:37.446725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.447109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.447631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.448615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:37.451444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:37.497410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1083/2179] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:37 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:15:37.501693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:37.514760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ecb8-5c4b-4391-bad8-6c85198f0029 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:37.591336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:37.592787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.593326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.593811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.594797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:37.597969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:37.644276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1097/2180] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:37 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:37.650526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:37.663158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51168-2a59-4539-970b-74d4e3f4304b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:37.683975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:37.685433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.685789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.686137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.686960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:37.692065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:37.727652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1084/2181] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:37.732211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:37.745775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f95ba-ee3c-44eb-a4c8-e429a74414c8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:37.751622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:37.753788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.754248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.755535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] PATH_INFO: `/v3/projects/bbe83e5066e543b4831b2ffc79db0d98/users/51dd9856aa4f41b9ad1012cfa6a9a76d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.760696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:37.782049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe83e5066e543b4831b2ffc79db0d98, user_id=51dd9856aa4f41b9ad1012cfa6a9a76d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:37.786648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:37.808567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1098/2182] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:37 2022] PUT /identity/v3/projects/bbe83e5066e543b4831b2ffc79db0d98/users/51dd9856aa4f41b9ad1012cfa6a9a76d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:37.812545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:37.825326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107e96-61b4-4abb-b605-b17265a8333c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:37.905357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4a68-b573-4fd8-bf53-bf106d18f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:37.906085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4a68-b573-4fd8-bf53-bf106d18f0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.906369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4a68-b573-4fd8-bf53-bf106d18f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.906841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4a68-b573-4fd8-bf53-bf106d18f0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.907763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d4a68-b573-4fd8-bf53-bf106d18f0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:37.909826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d4a68-b573-4fd8-bf53-bf106d18f0ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:37.923384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1085/2183] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:37.928364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:37.940898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d61f-e461-44b8-ac5a-ebd7e97351aa admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:37.947442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7fb2-2e45-43ec-b119-3995721d58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:37.948610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7fb2-2e45-43ec-b119-3995721d58dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:37.949076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7fb2-2e45-43ec-b119-3995721d58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:37.949531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7fb2-2e45-43ec-b119-3995721d58dc admin admin] PATH_INFO: `/v3/projects/bbe83e5066e543b4831b2ffc79db0d98/users/51dd9856aa4f41b9ad1012cfa6a9a76d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:37.952077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7fb2-2e45-43ec-b119-3995721d58dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe83e5066e543b4831b2ffc79db0d98, user_id=51dd9856aa4f41b9ad1012cfa6a9a76d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:37.955382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7fb2-2e45-43ec-b119-3995721d58dc admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:37.973376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1099/2184] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:37 2022] PUT /identity/v3/projects/bbe83e5066e543b4831b2ffc79db0d98/users/51dd9856aa4f41b9ad1012cfa6a9a76d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:40.235248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf547599-157c-40b8-bf28-0cb1fdc1e743 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:40.235786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf547599-157c-40b8-bf28-0cb1fdc1e743 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:40.237401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf547599-157c-40b8-bf28-0cb1fdc1e743 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:40.238984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1086/2185] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:15:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:15:40.261634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:40.262789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:40.263483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:40.315432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] MFA Rules not processed for user `d3b3524ba3d94d45ad789b39e0380b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:40.317554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:40.437375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf547599-157c-40b8-bf28-0cb1fdc1e743 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:40.439290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cf547599-157c-40b8-bf28-0cb1fdc1e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:40.509791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:40.525007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1100/2186] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:15:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:40.537348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:40.541584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:40.580546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4e8eb-18d5-4fb7-b526-58e1530dcf66 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:40.588009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37ba90-7226-490c-bec3-950ecd85c55c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:40.588946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37ba90-7226-490c-bec3-950ecd85c55c service placement] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:40.589487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37ba90-7226-490c-bec3-950ecd85c55c service placement] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:40.589904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37ba90-7226-490c-bec3-950ecd85c55c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:40.605280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37ba90-7226-490c-bec3-950ecd85c55c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:40.607349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37ba90-7226-490c-bec3-950ecd85c55c service placement] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:40.609299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf547599-157c-40b8-bf28-0cb1fdc1e743 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:40.615056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:40.616319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:40.616712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:40.617528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] PATH_INFO: `/v3/users/958873085c76404bb8c68efcd6516281` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:40.620536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=958873085c76404bb8c68efcd6516281)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:40.622906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:40.638399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1101/2187] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:40.774316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958873085c76404bb8c68efcd6516281'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:40.791834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958873085c76404bb8c68efcd6516281'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:40.797767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958873085c76404bb8c68efcd6516281'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:40.799243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958873085c76404bb8c68efcd6516281'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:40.834292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:40.835145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:40.835632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:40.839904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958873085c76404bb8c68efcd6516281'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:40.888355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1087/2188] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:40 2022] DELETE /identity/v3/users/958873085c76404bb8c68efcd6516281 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:40.892831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:40.895020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:41.045989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1102/2189] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:15:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:15:41.067598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:41.069104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:41.220882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:41.223942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:41.268722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f5d1d-2ac4-4776-b829-7d2debb2d7ab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:41.285508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:41.286250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:41.286521 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:41.286792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:41.332854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:41.338834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:41.358792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1088/2190] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:15:41.450864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b92959-2ac6-4141-bacc-265e5a51717c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:41.467097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:41.467988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:41.468264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:41.468530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] PATH_INFO: `/v3/projects/7d3510effdac4105bdbe85d6e6635575` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:41.469943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3510effdac4105bdbe85d6e6635575)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:41.472051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:41.477783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:41.605568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3510effdac4105bdbe85d6e6635575', 'request_id': 'req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:41.618360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3510effdac4105bdbe85d6e6635575', 'request_id': 'req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:41.641510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3510effdac4105bdbe85d6e6635575', 'request_id': 'req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:41.675123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] The token cache is being invalidate because project 7d3510effdac4105bdbe85d6e6635575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:41.677069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:41.680777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:41.684430 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1103/2191] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:41 2022] DELETE /identity/v3/projects/7d3510effdac4105bdbe85d6e6635575 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:41.688876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:41.708920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f268cac-78ec-4d4c-b46d-a9da72b6e9d5 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:41.811405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:41.899121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:41.900501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:41.901093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:41.901504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] PATH_INFO: `/v3/users/7ce071c53d354b4faf8bcc8b535eef9b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:41.910893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce071c53d354b4faf8bcc8b535eef9b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:41.915384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:42.053160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce071c53d354b4faf8bcc8b535eef9b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:42.073053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce071c53d354b4faf8bcc8b535eef9b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:42.074099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce071c53d354b4faf8bcc8b535eef9b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:42.074968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce071c53d354b4faf8bcc8b535eef9b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:42.087996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-4a66d089-4d7a-4c2f-9c85-3dac95d41191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce071c53d354b4faf8bcc8b535eef9b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:42.117850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1089/2192] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:41 2022] DELETE /identity/v3/users/7ce071c53d354b4faf8bcc8b535eef9b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:43.378262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:43.382572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:43.407626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bbfa-69ec-4ea2-bc6b-22f94a838983 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:43.552246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:43.553147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:43.553652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:43.554101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] PATH_INFO: `/v3/projects/07a0ae3bfacc4862ae69d11a849e6c68` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:43.555512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a0ae3bfacc4862ae69d11a849e6c68)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:43.557868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:43.631157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a0ae3bfacc4862ae69d11a849e6c68', 'request_id': 'req-8ff49378-8238-43d4-86dd-e11e00eb8eb1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:43.641707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a0ae3bfacc4862ae69d11a849e6c68', 'request_id': 'req-8ff49378-8238-43d4-86dd-e11e00eb8eb1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:43.658288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a0ae3bfacc4862ae69d11a849e6c68', 'request_id': 'req-8ff49378-8238-43d4-86dd-e11e00eb8eb1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:43.695698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] The token cache is being invalidate because project 07a0ae3bfacc4862ae69d11a849e6c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:15:43.698625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:43.699796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ff49378-8238-43d4-86dd-e11e00eb8eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:43.701785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1104/2193] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:43 2022] DELETE /identity/v3/projects/07a0ae3bfacc4862ae69d11a849e6c68 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:43.706926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:43.707440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:43.707849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:43.734928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:43.736598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:43.866837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1090/2194] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:15:43.871984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:43.872748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:43.872748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:43.951645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:43.952893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:43.985623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1105/2195] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:43.993100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:44.006058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131f3fc-3350-4b20-9ae2-e17b104c7ebc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:44.018406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:44.019413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.023584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.024191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.027213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:15:44.027647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:44.029445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:44.068667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1091/2196] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:15:44.070173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:44.098369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31780df-ded0-4ecb-aa11-67191cd603d2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:44.134621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:44.135386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.135614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.135883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.136596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:44.138644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:44.182426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:44.214169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1106/2197] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:44 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:44.219363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:44.246355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c17b5-ea8c-4dea-8829-e7231e728aa0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:44.414331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:44.470588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:44.475089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.476509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.478631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.481908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:44.494325 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:44.547822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1092/2198] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:44 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:44.549219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:44.567437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c3e6-5974-4d58-8e54-1f24e87dc2b4 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:44.608495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:44.609558 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.610048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.610550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.611624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:44.613609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:44.702487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:44.711899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1107/2199] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:44.722315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd03eb2-9e39-4e14-86a3-72bde1687ee1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:44.743718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142bd4-1b81-4f90-b7e8-171a88b6db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:44.744414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142bd4-1b81-4f90-b7e8-171a88b6db27 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.744750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142bd4-1b81-4f90-b7e8-171a88b6db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.745027 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142bd4-1b81-4f90-b7e8-171a88b6db27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.745808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3142bd4-1b81-4f90-b7e8-171a88b6db27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:44.748035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3142bd4-1b81-4f90-b7e8-171a88b6db27 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:44.775527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1093/2200] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:15:44.778594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:44.799898 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d903437-f729-42ef-a891-d7695799d41b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:44.823548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:44.824533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.825202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.825516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] PATH_INFO: `/v3/projects/ded7ab2307bd4898b6b264000705c01d/users/c9cda6c12dc44fbb95b3bfb20e09d527/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.865528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded7ab2307bd4898b6b264000705c01d, user_id=c9cda6c12dc44fbb95b3bfb20e09d527, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:44.868550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:44.908008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1108/2201] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:44 2022] PUT /identity/v3/projects/ded7ab2307bd4898b6b264000705c01d/users/c9cda6c12dc44fbb95b3bfb20e09d527/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:44.918652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:44.918944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:44.919227 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:44.977880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] MFA Rules not processed for user `c9cda6c12dc44fbb95b3bfb20e09d527`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:44.979127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:45.167712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1094/2202] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:45.168718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:45.343466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eff36-f5f3-4bc4-866f-9c2cbab60464 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:45.349649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:45.351080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:45.351680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:45.352136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:45.353636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:45.356413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:45.430263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1109/2203] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:45.434176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:45.453928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625a16a-4107-4dcf-ac3e-901b040134cc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:45.648265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:45.648984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:45.649331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:45.649661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:45.650386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:45.652371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:45.707357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1095/2204] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:15:45 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:15:45.708453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:45.725071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3291c4-59d4-4f7c-8d7c-66138d9f6f9f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:45.731960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:45.732924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:45.745358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:45.745887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:45.748685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:45.750612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:45.782738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1110/2205] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:45.786416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:45.805261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ce71-a473-4fef-9c7c-21978032edd7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:45.817089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:45.818202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:45.818741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:45.819154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] PATH_INFO: `/v3/projects/a846d95c1aec4e88b2fdfc3bddefae17/users/5daa3c339dfa4ff084180a80d5dc6ab4/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:45.861947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a846d95c1aec4e88b2fdfc3bddefae17, user_id=5daa3c339dfa4ff084180a80d5dc6ab4, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:45.864969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:45.892961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1096/2206] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:45 2022] PUT /identity/v3/projects/a846d95c1aec4e88b2fdfc3bddefae17/users/5daa3c339dfa4ff084180a80d5dc6ab4/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:15:45.898728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:45.916702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba7c8-da40-4846-9279-0ddc27c49748 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:46.008485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f478-36d0-46ba-aeee-df77c55d50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:46.009500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f478-36d0-46ba-aeee-df77c55d50dd admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:46.009931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f478-36d0-46ba-aeee-df77c55d50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:46.010489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f478-36d0-46ba-aeee-df77c55d50dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:46.011374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f478-36d0-46ba-aeee-df77c55d50dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:46.014170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f478-36d0-46ba-aeee-df77c55d50dd admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:46.032590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1111/2207] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:15:46.036746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:46.051756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcec0-cecb-4e15-89a9-1922d8b1a2ca admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:46.072023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:46.079156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:46.079710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:46.080162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] PATH_INFO: `/v3/projects/a846d95c1aec4e88b2fdfc3bddefae17/users/5daa3c339dfa4ff084180a80d5dc6ab4/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:46.087160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a846d95c1aec4e88b2fdfc3bddefae17, user_id=5daa3c339dfa4ff084180a80d5dc6ab4, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:46.092129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:46.134419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1097/2208] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:15:46 2022] PUT /identity/v3/projects/a846d95c1aec4e88b2fdfc3bddefae17/users/5daa3c339dfa4ff084180a80d5dc6ab4/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:46.136965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:46.137296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:46.137581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:46.273426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] MFA Rules not processed for user `5daa3c339dfa4ff084180a80d5dc6ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:46.274785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:46.308280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:46.447944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1112/2209] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:46.455623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:46.473095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:46.483740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:46.609538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169c7d-dabd-4ff3-9239-778a433a9388 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:46.618522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561065-771f-4842-9548-6a98b54f5816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:46.619672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561065-771f-4842-9548-6a98b54f5816 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:46.620168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561065-771f-4842-9548-6a98b54f5816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:46.620833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561065-771f-4842-9548-6a98b54f5816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:46.764090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561065-771f-4842-9548-6a98b54f5816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:46.765763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561065-771f-4842-9548-6a98b54f5816 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:46.807875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1098/2210] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:53.060080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:53.090914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295e8e-3398-43dc-ade9-8084efd8ef39 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:53.100211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:53.100928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:53.102948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:53.103270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:53.124446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:53.126293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:53.146890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1113/2211] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:54.967861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276366c-78a3-4499-af60-f1b0fa8a4298 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:54.968384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276366c-78a3-4499-af60-f1b0fa8a4298 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:54.968479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276366c-78a3-4499-af60-f1b0fa8a4298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:55.011437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4276366c-78a3-4499-af60-f1b0fa8a4298 None None] MFA Rules not processed for user `51dd9856aa4f41b9ad1012cfa6a9a76d`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:55.012971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4276366c-78a3-4499-af60-f1b0fa8a4298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:55.129287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1099/2212] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:55.355513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:55.357043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:55.517433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910155e3-5fc4-4767-8f65-d49d9a2deb5f service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:55.526059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2405-3483-485a-af25-377132c9023b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:55.526998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2405-3483-485a-af25-377132c9023b service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:55.527433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2405-3483-485a-af25-377132c9023b service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:55.527762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2405-3483-485a-af25-377132c9023b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:55.530172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-aabb2405-3483-485a-af25-377132c9023b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:55.705080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb2405-3483-485a-af25-377132c9023b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:55.706711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb2405-3483-485a-af25-377132c9023b service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:55.722293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1114/2213] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:57.876596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1c2c-42f9-49f3-be9e-c8f923954b05 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:57.877362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1c2c-42f9-49f3-be9e-c8f923954b05 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:57.877362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1c2c-42f9-49f3-be9e-c8f923954b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:57.907049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c8bc1c2c-42f9-49f3-be9e-c8f923954b05 None None] MFA Rules not processed for user `34a67e50fe91465391ee1afa15ed433a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:57.908523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c8bc1c2c-42f9-49f3-be9e-c8f923954b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:57.917564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1100/2214] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:58.974443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2405-3483-485a-af25-377132c9023b service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:59.016765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:59.054147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2405-3483-485a-af25-377132c9023b service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:59.059093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:59.060778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:59.061056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:59.061386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] PATH_INFO: `/v3/users/c9cda6c12dc44fbb95b3bfb20e09d527` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:59.062717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cda6c12dc44fbb95b3bfb20e09d527)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:59.064828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:59.134083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cda6c12dc44fbb95b3bfb20e09d527'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.151146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cda6c12dc44fbb95b3bfb20e09d527'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.152929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cda6c12dc44fbb95b3bfb20e09d527'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.153552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cda6c12dc44fbb95b3bfb20e09d527'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.162439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cda6c12dc44fbb95b3bfb20e09d527'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.186424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1115/2215] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:15:58 2022] DELETE /identity/v3/users/c9cda6c12dc44fbb95b3bfb20e09d527 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:15:59.188117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:59.188628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:59.188714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:59.214011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:15:59.215480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:59.253447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:59.285178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1101/2216] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:15:59.298916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:59.300614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:59.374965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cff81-0f9e-4364-9e2c-5acc22ab760b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:59.378830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:59.379592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:59.379881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:59.380157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:59.391245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:59.392719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:59.404187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1116/2217] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:15:59.838721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:15:59.840843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:15:59.870444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564391-702b-4c01-9031-ee36a357c9cc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:15:59.877676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:15:59.879731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:15:59.880268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:15:59.880730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] PATH_INFO: `/v3/projects/ded7ab2307bd4898b6b264000705c01d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:15:59.882607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded7ab2307bd4898b6b264000705c01d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:15:59.890363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:15:59.966862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded7ab2307bd4898b6b264000705c01d', 'request_id': 'req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.979947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded7ab2307bd4898b6b264000705c01d', 'request_id': 'req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:15:59.991605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded7ab2307bd4898b6b264000705c01d', 'request_id': 'req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.020488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] The token cache is being invalidate because project ded7ab2307bd4898b6b264000705c01d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:00.021159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.022242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.029560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1102/2218] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:15:59 2022] DELETE /identity/v3/projects/ded7ab2307bd4898b6b264000705c01d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:00.034303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:00.044851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b585d1e-870d-4552-9867-08158a61e942 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:00.159571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:00.167133 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:00.168152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:00.173373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:00.173373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] PATH_INFO: `/v3/users/5daa3c339dfa4ff084180a80d5dc6ab4` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:00.174931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daa3c339dfa4ff084180a80d5dc6ab4)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:00.178643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:00.251323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daa3c339dfa4ff084180a80d5dc6ab4'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.269241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daa3c339dfa4ff084180a80d5dc6ab4'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.270479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daa3c339dfa4ff084180a80d5dc6ab4'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.273995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daa3c339dfa4ff084180a80d5dc6ab4'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.287321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-10943a51-2550-49fb-b3be-20a54f080726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daa3c339dfa4ff084180a80d5dc6ab4'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.315469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1117/2219] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:00 2022] DELETE /identity/v3/users/5daa3c339dfa4ff084180a80d5dc6ab4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:00.669658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:00.672410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:00.689045 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3dd4b-ae4a-4356-b4df-3233f911cbf4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:00.779662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:00.780777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:00.781158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:00.781557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] PATH_INFO: `/v3/projects/a846d95c1aec4e88b2fdfc3bddefae17` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:00.782893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a846d95c1aec4e88b2fdfc3bddefae17)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:00.785322 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:00.853500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a846d95c1aec4e88b2fdfc3bddefae17', 'request_id': 'req-03ca866e-8780-4635-8a98-daf25721fa71'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.864204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a846d95c1aec4e88b2fdfc3bddefae17', 'request_id': 'req-03ca866e-8780-4635-8a98-daf25721fa71'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.874173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a846d95c1aec4e88b2fdfc3bddefae17', 'request_id': 'req-03ca866e-8780-4635-8a98-daf25721fa71'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.876956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:00.908850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] The token cache is being invalidate because project a846d95c1aec4e88b2fdfc3bddefae17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:00.909935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.911239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-03ca866e-8780-4635-8a98-daf25721fa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:00.918327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1103/2220] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:00 2022] DELETE /identity/v3/projects/a846d95c1aec4e88b2fdfc3bddefae17 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:00.925530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:00.925951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:00.926325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:00.948295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:00.949961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:01.038936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1118/2221] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:01.051186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.051835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.052723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.088832 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:01.090279 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:01.111346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1104/2222] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:01.115667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.129653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2a76b-e6c8-432b-8c40-1730cfdf95c9 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.136024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.136297 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.136769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.138016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.138944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:16:01.139581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.142021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.159931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1119/2223] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:16:01.166010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.179190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c1e0-cfa1-4a30-bfc3-0f04f4c0c4c2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.188181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.188874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.189176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.189535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.190312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.192255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.233657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1105/2224] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:01 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:16:01.237551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.258786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12273-7835-455b-b41b-048365e81f73 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.363963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.364858 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.365280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.365647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.366910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.369166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.378652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:01.405704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1120/2225] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:01 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:16:01.409846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.423201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb282e-8043-4497-a030-abfe565508e8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.429183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.430148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.430522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.431216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.431651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.433362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.445801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1106/2226] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:01.454366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.471962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaea737-8607-4cef-a4b4-72547cdcf703 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.478735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f3142-93c0-4144-9cf3-e73f1eaa3e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.479409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f3142-93c0-4144-9cf3-e73f1eaa3e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.479673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f3142-93c0-4144-9cf3-e73f1eaa3e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.479938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f3142-93c0-4144-9cf3-e73f1eaa3e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.480669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f3142-93c0-4144-9cf3-e73f1eaa3e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.482967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f3142-93c0-4144-9cf3-e73f1eaa3e41 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.500548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1121/2227] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:01.501535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.514019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c664e-a83d-4fc6-a219-43035ef47b5e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.551427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.552361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.552685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.552979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] PATH_INFO: `/v3/projects/12be1129ad90494492503dd85cb90f2c/users/3a2b9cbfbdf1434f9bcc53c60b7eb86b/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.573284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12be1129ad90494492503dd85cb90f2c, user_id=3a2b9cbfbdf1434f9bcc53c60b7eb86b, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.577328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.598693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1107/2228] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:01 2022] PUT /identity/v3/projects/12be1129ad90494492503dd85cb90f2c/users/3a2b9cbfbdf1434f9bcc53c60b7eb86b/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:01.610682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.610971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.611245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.648367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] MFA Rules not processed for user `3a2b9cbfbdf1434f9bcc53c60b7eb86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:01.649967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:01.756883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1122/2229] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:01.762043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.840533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7989ee-37b9-4de7-9046-65bd7832f719 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.846535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.847387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.847919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.848494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.849906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.851478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.882283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1108/2230] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:01 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:01.886720 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:01.902966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cdb5e-e693-4bec-9688-1c34afc3e411 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:01.965202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:01.966147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:01.966424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:01.966696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:01.969775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:01.969775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:01.993559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1123/2231] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:01 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:01.998040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:02.010485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553f59-bb36-47b3-a934-ee8015bc7b07 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:02.017052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:02.018095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:02.018287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:02.018838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:02.019627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:02.021366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:02.033824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1109/2232] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:02.038281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:02.053523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ee20-a91e-4a6e-8c93-dac3c8111708 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:02.065372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:02.070418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:02.070418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:02.070418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] PATH_INFO: `/v3/projects/c9c742dc231148198dfd62b76b52a46b/users/d6fc97ccd2a64f798f2e10eb33ee51af/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:02.114645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c742dc231148198dfd62b76b52a46b, user_id=d6fc97ccd2a64f798f2e10eb33ee51af, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:02.118958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:02.138371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1124/2233] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:02 2022] PUT /identity/v3/projects/c9c742dc231148198dfd62b76b52a46b/users/d6fc97ccd2a64f798f2e10eb33ee51af/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:02.143518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:02.155597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea3ae-684d-497b-a573-d5bfa03fae70 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:02.299680 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a86e-f70b-41cd-9209-89e1a6c2c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:02.300411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a86e-f70b-41cd-9209-89e1a6c2c573 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:02.300752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a86e-f70b-41cd-9209-89e1a6c2c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:02.301628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a86e-f70b-41cd-9209-89e1a6c2c573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:02.301974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a86e-f70b-41cd-9209-89e1a6c2c573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:02.303679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a86e-f70b-41cd-9209-89e1a6c2c573 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:02.309502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:02.334629 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1110/2234] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:02.336355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:02.348628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f733-ed52-4936-8232-b5fe389f6f87 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:02.357620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:02.358784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:02.359227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:02.359596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] PATH_INFO: `/v3/projects/c9c742dc231148198dfd62b76b52a46b/users/d6fc97ccd2a64f798f2e10eb33ee51af/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:02.362181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c742dc231148198dfd62b76b52a46b, user_id=d6fc97ccd2a64f798f2e10eb33ee51af, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:02.365329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:02.397320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1125/2235] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:02 2022] PUT /identity/v3/projects/c9c742dc231148198dfd62b76b52a46b/users/d6fc97ccd2a64f798f2e10eb33ee51af/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:02.407287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:02.411092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:02.413361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:02.458960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] MFA Rules not processed for user `d6fc97ccd2a64f798f2e10eb33ee51af`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:02.460969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:02.591417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1111/2236] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:02.601224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:02.603581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:02.650795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:02.701363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52a36-fd8f-41e3-8931-47a70febbd79 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:02.704961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5efea-2858-4469-a7f2-ce911fd6bdad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:02.705662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5efea-2858-4469-a7f2-ce911fd6bdad service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:02.705936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5efea-2858-4469-a7f2-ce911fd6bdad service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:02.706214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5efea-2858-4469-a7f2-ce911fd6bdad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:02.787355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5efea-2858-4469-a7f2-ce911fd6bdad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:02.788982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5efea-2858-4469-a7f2-ce911fd6bdad service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:02.799700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1126/2237] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:05.433143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:05.503890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4d171-7db3-47e2-a507-651410df493e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:05.509630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:05.510530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:05.510794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:05.511063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] PATH_INFO: `/v3/users/3a2b9cbfbdf1434f9bcc53c60b7eb86b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:05.512294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2b9cbfbdf1434f9bcc53c60b7eb86b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:05.514439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:05.565471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2b9cbfbdf1434f9bcc53c60b7eb86b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:05.578871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2b9cbfbdf1434f9bcc53c60b7eb86b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:05.579538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2b9cbfbdf1434f9bcc53c60b7eb86b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:05.580203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2b9cbfbdf1434f9bcc53c60b7eb86b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:05.591811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2b9cbfbdf1434f9bcc53c60b7eb86b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:05.611960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1112/2238] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:05 2022] DELETE /identity/v3/users/3a2b9cbfbdf1434f9bcc53c60b7eb86b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:05.614259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:05.614830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:05.614926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:05.651730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:05.653199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:05.724741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1127/2239] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:05.738568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:05.740037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:05.745621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:05.810681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332b18f-54f9-4750-a535-e8e40e58a139 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:05.814494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:05.815158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:05.815436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:05.815710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:05.825442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:05.826885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:05.837559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1113/2240] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:06.145852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:06.147744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:06.161183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde9990-c52a-46dd-a622-8ef9a0668154 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:06.166461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:06.167402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:06.168448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:06.168448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] PATH_INFO: `/v3/projects/12be1129ad90494492503dd85cb90f2c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:06.169386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12be1129ad90494492503dd85cb90f2c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:06.171563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:06.243142 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12be1129ad90494492503dd85cb90f2c', 'request_id': 'req-a39592b0-0659-43af-aa42-b0f4f9757739'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.249181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12be1129ad90494492503dd85cb90f2c', 'request_id': 'req-a39592b0-0659-43af-aa42-b0f4f9757739'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.255729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12be1129ad90494492503dd85cb90f2c', 'request_id': 'req-a39592b0-0659-43af-aa42-b0f4f9757739'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.272442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] The token cache is being invalidate because project 12be1129ad90494492503dd85cb90f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:06.272874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.273562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.275448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1128/2241] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:06 2022] DELETE /identity/v3/projects/12be1129ad90494492503dd85cb90f2c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:06.279569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:06.289901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767684ad-a738-4efc-b900-6fa2aa243144 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:06.379385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:06.381141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:06.381663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:06.383414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] PATH_INFO: `/v3/users/d6fc97ccd2a64f798f2e10eb33ee51af` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:06.385036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fc97ccd2a64f798f2e10eb33ee51af)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:06.387460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:06.470947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fc97ccd2a64f798f2e10eb33ee51af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.492220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fc97ccd2a64f798f2e10eb33ee51af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.493309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fc97ccd2a64f798f2e10eb33ee51af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.493917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fc97ccd2a64f798f2e10eb33ee51af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.502328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c036f91a-93e2-4f27-86c7-e0248385138b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fc97ccd2a64f798f2e10eb33ee51af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:06.549307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1114/2242] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:06 2022] DELETE /identity/v3/users/d6fc97ccd2a64f798f2e10eb33ee51af => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:06.949787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:06.951374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:06.959876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:06.967906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39592b0-0659-43af-aa42-b0f4f9757739 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.037717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.039130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.039639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.040070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] PATH_INFO: `/v3/projects/c9c742dc231148198dfd62b76b52a46b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.041495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c742dc231148198dfd62b76b52a46b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.043765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.101569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c742dc231148198dfd62b76b52a46b', 'request_id': 'req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:07.108401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c742dc231148198dfd62b76b52a46b', 'request_id': 'req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:07.117168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c742dc231148198dfd62b76b52a46b', 'request_id': 'req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:07.136662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] The token cache is being invalidate because project c9c742dc231148198dfd62b76b52a46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:07.136951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:07.137611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1d5d6bc1-d588-4f6d-a233-89ae57f3aac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:07.139195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1129/2243] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:06 2022] DELETE /identity/v3/projects/c9c742dc231148198dfd62b76b52a46b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:07.144341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.144778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.145457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.166952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:07.168358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:07.191766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:07.245947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1115/2244] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:07.254964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.255240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.255612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.274830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:07.276164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:07.287487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1130/2245] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:07.289419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.311926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c93f6a-c43c-4308-bc42-b3c8bd3a99d3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.317518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.318782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.319066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.319333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.321043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:16:07.321294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.323676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.345791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1116/2246] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:16:07.349120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.359384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a0303-1fea-44c6-844e-d3557e55aa14 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.367263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.367941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.368244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.368799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.369566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.371494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.423396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1131/2247] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:07 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:07.427824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.438297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b8e7-c0f0-41b0-9116-c319bcb5f64c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.507876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.508525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.508827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.509412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.510044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.512307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.539614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1117/2248] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:07 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:16:07.541085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.556520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0002-9a5d-4c4d-8878-a1669f99c3c8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.561911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.562721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.563047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.563417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.564278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.566294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.579694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1132/2249] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:07.584135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.595880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b1d0e-5a7d-4cdc-a5fd-eae916317fef admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.600791 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfcfb4-8a08-4a49-9a04-221dc0c9bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.601519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfcfb4-8a08-4a49-9a04-221dc0c9bbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.601798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfcfb4-8a08-4a49-9a04-221dc0c9bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.602066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfcfb4-8a08-4a49-9a04-221dc0c9bbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.602827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfcfb4-8a08-4a49-9a04-221dc0c9bbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.604498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfcfb4-8a08-4a49-9a04-221dc0c9bbe4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.617577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1118/2250] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:07.621645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.634926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4a3d-5dbe-445b-8e5b-9a622d43ae96 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.639653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.640762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.640889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.641094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] PATH_INFO: `/v3/projects/bcaf623329fd4a68ae2807a57913cac0/users/3acce7f555d24d7a91953d52dff5bb29/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.659954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcaf623329fd4a68ae2807a57913cac0, user_id=3acce7f555d24d7a91953d52dff5bb29, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:07.662762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:07.679036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1133/2251] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:07 2022] PUT /identity/v3/projects/bcaf623329fd4a68ae2807a57913cac0/users/3acce7f555d24d7a91953d52dff5bb29/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:16:07.689966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.690257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.690533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.721048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] MFA Rules not processed for user `3acce7f555d24d7a91953d52dff5bb29`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:07.722696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:07.850861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1119/2252] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:07.855525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:07.918089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:07.988399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb268b3-b637-4f6d-b2bd-84f0ddfa69b6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:07.995940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f7d90-499f-422a-90ad-7efb2285c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:07.996670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7d90-499f-422a-90ad-7efb2285c83f admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:07.996963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7d90-499f-422a-90ad-7efb2285c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:07.997274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7d90-499f-422a-90ad-7efb2285c83f admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:07.998060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7d90-499f-422a-90ad-7efb2285c83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.000046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7d90-499f-422a-90ad-7efb2285c83f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.042823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1134/2253] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:07 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:08.046998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.069786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1b54-892a-4ddb-8c1b-0c57a73da7bf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.106786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:08.166874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.167381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.167811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.188557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.190190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.190483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.190948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.193496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.193705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:08.195262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:08.201109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.233811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1120/2254] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:08 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:08.236028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.250358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82860f-d890-4868-ba2a-a8fbb1e8b65a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.255820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.256494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.257842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.257842 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.258202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.259946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.291928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1121/2255] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:16:08.301748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.320015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dda76d-844d-4d8b-9994-2d9a6386cea7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.327720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.328589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.328858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.329265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.330017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.331818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.346705 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1122/2256] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:08.350184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1135/2257] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:08.351281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.363773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be30d2-3b1b-4236-9fdd-bbe29efaed49 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.368643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.369248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171241b-e082-4348-8e4f-c960b80a21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.370380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171241b-e082-4348-8e4f-c960b80a21b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.370660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171241b-e082-4348-8e4f-c960b80a21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.370776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:08.370929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171241b-e082-4348-8e4f-c960b80a21b8 admin admin] PATH_INFO: `/v3/projects/8b8e68790d734a059d64d84d35e30457/users/bc8d57801c13441bb7258131fbc30487/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.390602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171241b-e082-4348-8e4f-c960b80a21b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8e68790d734a059d64d84d35e30457, user_id=bc8d57801c13441bb7258131fbc30487, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.394443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171241b-e082-4348-8e4f-c960b80a21b8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.432724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1123/2258] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:08 2022] PUT /identity/v3/projects/8b8e68790d734a059d64d84d35e30457/users/bc8d57801c13441bb7258131fbc30487/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:08.444517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.444966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.445349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.501422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] MFA Rules not processed for user `bc8d57801c13441bb7258131fbc30487`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:08.504348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:08.518292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199fc7-1318-4cc0-ab6c-e4bb6c5daadb None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.636619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1124/2259] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:08.637963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.661099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:08.671476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.672397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.673317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.673675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.756729 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.759210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.770225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1136/2260] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:16:08.771697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:08.792658 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055296d4-ef9a-4cac-8cbc-cbfdca735e2d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.798420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.799161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.799454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.799718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.813610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.817159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:08.866555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1125/2261] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:08 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:08.872893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:08.895571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c55d-5a99-408e-bca6-642c27182fa3 service swift] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:08.992209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:08.993042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:08.993250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:08.993775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:08.995978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:08.996853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:09.064244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1137/2262] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:08 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:09.064756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:09.080689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621a355-56ce-46cd-9920-80ab0bf939ca admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:09.097689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:09.098642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:09.098921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:09.099194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:09.099933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:09.101710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:09.124694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1126/2263] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:16:09.126515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:09.139491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055a7e-81e5-48eb-8d81-af7c5ae3879c admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:09.149301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:09.150553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:09.150828 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:09.151099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] PATH_INFO: `/v3/projects/882513d2b561436b9c717e7e62b53407/users/947cb672bb8d4807b895d7f45979bce0/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:09.178117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882513d2b561436b9c717e7e62b53407, user_id=947cb672bb8d4807b895d7f45979bce0, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:09.181721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:09.206431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:09.208896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1138/2264] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:09 2022] PUT /identity/v3/projects/882513d2b561436b9c717e7e62b53407/users/947cb672bb8d4807b895d7f45979bce0/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:09.226320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0be1d-298c-4cdb-9f57-aa828d5f9004 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:09.357269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c73a2-c2a1-44c1-9bb7-ebfc8b1b78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:09.358030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c73a2-c2a1-44c1-9bb7-ebfc8b1b78a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:09.358308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c73a2-c2a1-44c1-9bb7-ebfc8b1b78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:09.358613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c73a2-c2a1-44c1-9bb7-ebfc8b1b78a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:09.359417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c73a2-c2a1-44c1-9bb7-ebfc8b1b78a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:09.361454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c73a2-c2a1-44c1-9bb7-ebfc8b1b78a0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:09.373722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1127/2265] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:09.378940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:09.390966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40efa04-5a5b-41cc-9ea4-16d61f542222 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:09.399247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:09.400268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:09.400545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:09.400811 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] PATH_INFO: `/v3/projects/882513d2b561436b9c717e7e62b53407/users/947cb672bb8d4807b895d7f45979bce0/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:09.407602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=882513d2b561436b9c717e7e62b53407, user_id=947cb672bb8d4807b895d7f45979bce0, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:09.411433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:09.448693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1139/2266] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:09 2022] PUT /identity/v3/projects/882513d2b561436b9c717e7e62b53407/users/947cb672bb8d4807b895d7f45979bce0/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:09.512575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50403-89b6-43ec-8cb4-a561e2c734be None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:09.512899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50403-89b6-43ec-8cb4-a561e2c734be None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:09.513215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50403-89b6-43ec-8cb4-a561e2c734be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:09.579396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-92b50403-89b6-43ec-8cb4-a561e2c734be None None] MFA Rules not processed for user `947cb672bb8d4807b895d7f45979bce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:09.581510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-92b50403-89b6-43ec-8cb4-a561e2c734be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:09.694787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1128/2267] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:16:09.726882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:09.728922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:09.881294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9b6fb-1417-4a23-92c6-b82063b90f5f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:09.886228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:09.888528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:09.889038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:09.889489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:09.906819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:10.015227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:10.017062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:10.047108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1140/2268] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:10.453890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:10.454218 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:10.454501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:10.490805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] MFA Rules not processed for user `5ed9d1c1ec4f419898831b7557b93693`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:10.507360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:10.607626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:10.623341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1129/2269] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:12.053336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:12.064122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed8ff-7579-4512-9107-d0a067b496a9 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:12.068806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:12.071532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:12.072010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:12.074191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:12.221259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:12.223061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:12.235469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1141/2270] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:16:13.383821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:13.385792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:13.404213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6c5cc-c7ce-4873-87bf-d0388867ce23 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:13.408848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:13.409821 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:13.410259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:13.411261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:13.427435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:13.430144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:13.454872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1130/2271] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:18.280267 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:18.282455 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:18.480047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b396497-efda-4aec-93d3-1b51975930c3 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:18.494093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:18.494827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:18.495769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:18.496051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:18.498777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:18.680579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:18.687244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a0aca-a348-4fc6-835c-605f4604323a service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:18.691882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:18.715963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1142/2272] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:18.895977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:19.006636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ecc19-db4e-439f-8791-acc3f2a1d448 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:19.012570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:19.013851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:19.014458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:19.015484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] PATH_INFO: `/v3/users/3acce7f555d24d7a91953d52dff5bb29` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:19.016816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acce7f555d24d7a91953d52dff5bb29)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:19.019112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:19.103478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acce7f555d24d7a91953d52dff5bb29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:19.135881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acce7f555d24d7a91953d52dff5bb29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:19.138984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acce7f555d24d7a91953d52dff5bb29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:19.141369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acce7f555d24d7a91953d52dff5bb29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:19.160946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acce7f555d24d7a91953d52dff5bb29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:19.203166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1131/2273] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:18 2022] DELETE /identity/v3/users/3acce7f555d24d7a91953d52dff5bb29 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:19.208086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:19.208629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:19.208981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:19.285408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:19.286810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:19.445957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1143/2274] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:19.469803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:19.472180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:19.611701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a6714-ae30-454a-979a-c9ce09cefc74 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:19.615626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:19.617586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:19.617586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:19.617586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:19.636505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:19.639794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:19.677125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1132/2275] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:16:20.395387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:20.400270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:20.425918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d24b-fc0a-4026-ae71-02ed4f80ee3f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:20.484006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:20.484903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:20.485181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:20.485552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] PATH_INFO: `/v3/projects/bcaf623329fd4a68ae2807a57913cac0` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:20.492366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcaf623329fd4a68ae2807a57913cac0)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:20.500851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:20.671918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcaf623329fd4a68ae2807a57913cac0', 'request_id': 'req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:20.692610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcaf623329fd4a68ae2807a57913cac0', 'request_id': 'req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:20.760245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcaf623329fd4a68ae2807a57913cac0', 'request_id': 'req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:20.783255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] The token cache is being invalidate because project bcaf623329fd4a68ae2807a57913cac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:20.784881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:20.787500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:20.794810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1144/2276] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:20 2022] DELETE /identity/v3/projects/bcaf623329fd4a68ae2807a57913cac0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:20.799646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:20.804619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:20.815212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a0af-9e1d-4322-ada3-817a41c152cd service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:20.963151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:20.964619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:20.965124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:20.965717 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] PATH_INFO: `/v3/users/bc8d57801c13441bb7258131fbc30487` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:20.970369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8d57801c13441bb7258131fbc30487)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:20.972484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:21.098865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8d57801c13441bb7258131fbc30487'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:21.138154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8d57801c13441bb7258131fbc30487'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:21.139392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8d57801c13441bb7258131fbc30487'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:21.144610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8d57801c13441bb7258131fbc30487'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:21.165254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8d57801c13441bb7258131fbc30487'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:21.192649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1133/2277] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:20 2022] DELETE /identity/v3/users/bc8d57801c13441bb7258131fbc30487 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:22.431526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:22.433310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:22.458017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d0d4-abdc-40c4-a9f4-439eb78826d5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:22.603174 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:22.604393 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:22.604777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:22.605147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] PATH_INFO: `/v3/projects/8b8e68790d734a059d64d84d35e30457` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:22.607976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8e68790d734a059d64d84d35e30457)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:22.610952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:22.673037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:22.739547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8e68790d734a059d64d84d35e30457', 'request_id': 'req-adb5829d-1e9a-4df5-be61-dbe8df986810'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:22.753426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8e68790d734a059d64d84d35e30457', 'request_id': 'req-adb5829d-1e9a-4df5-be61-dbe8df986810'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:22.777661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8e68790d734a059d64d84d35e30457', 'request_id': 'req-adb5829d-1e9a-4df5-be61-dbe8df986810'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:22.812849 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] The token cache is being invalidate because project 8b8e68790d734a059d64d84d35e30457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:22.814230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:22.815363 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:22.819847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1145/2278] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:22 2022] DELETE /identity/v3/projects/8b8e68790d734a059d64d84d35e30457 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:22.824384 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:22.826531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:22.861770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b225a-65b2-42f4-9513-367960613945 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:23.005065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:23.006388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:23.006686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:23.007082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] PATH_INFO: `/v3/users/947cb672bb8d4807b895d7f45979bce0` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:23.012764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947cb672bb8d4807b895d7f45979bce0)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:23.015140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:23.119675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:23.181377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947cb672bb8d4807b895d7f45979bce0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:23.203779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947cb672bb8d4807b895d7f45979bce0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:23.205171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947cb672bb8d4807b895d7f45979bce0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:23.207479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947cb672bb8d4807b895d7f45979bce0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:23.218238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7cd39b41-996d-468e-b487-4e8c66a32d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947cb672bb8d4807b895d7f45979bce0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:23.263532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1134/2279] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:22 2022] DELETE /identity/v3/users/947cb672bb8d4807b895d7f45979bce0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:24.006399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.007917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:24.025870 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5829d-1e9a-4df5-be61-dbe8df986810 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.120606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.122425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.122718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.122975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] PATH_INFO: `/v3/projects/882513d2b561436b9c717e7e62b53407` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.124968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882513d2b561436b9c717e7e62b53407)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.128929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.197784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882513d2b561436b9c717e7e62b53407', 'request_id': 'req-dc090f4e-5835-4953-ba5c-a5fda15ac251'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:24.206681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882513d2b561436b9c717e7e62b53407', 'request_id': 'req-dc090f4e-5835-4953-ba5c-a5fda15ac251'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:24.235321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882513d2b561436b9c717e7e62b53407', 'request_id': 'req-dc090f4e-5835-4953-ba5c-a5fda15ac251'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:24.261821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] The token cache is being invalidate because project 882513d2b561436b9c717e7e62b53407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:24.262220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:24.263314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-dc090f4e-5835-4953-ba5c-a5fda15ac251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:24.265202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1146/2280] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:24 2022] DELETE /identity/v3/projects/882513d2b561436b9c717e7e62b53407 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:24.270574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.271068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.271159 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.297966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:24.299186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:24.389344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1135/2281] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:16:24.390457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.390995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.391546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.427227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:24.428617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:24.437399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1147/2282] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:16:24.441924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.456443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede44d9-935c-4c74-90d5-bd529f8299a2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.468522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.469538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.469918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.470381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.471776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:16:24.472336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.474858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.493369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1136/2283] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:16:24.494289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.506084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ce96-577e-4169-84df-e833609a4a97 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.511911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.512657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.513010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.513376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.514164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.516202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.556990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1148/2284] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:24 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:24.561043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.574975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d387b-af18-432f-bb05-a73368816b27 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.644433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.645058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.645493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.645768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.646589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.648865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.674969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1137/2285] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:24 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:24.679380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.689911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1388-4b17-40d1-a97d-46913d6432e2 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.694667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.695330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.695605 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.695872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.696598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.698228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.710278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1149/2286] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:24.714830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.725869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c139ffa-69df-4f47-abe1-3fd97d68f45f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.731671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3287-5916-4805-8832-5e39d08af1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.732362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3287-5916-4805-8832-5e39d08af1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.732641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3287-5916-4805-8832-5e39d08af1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.732909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3287-5916-4805-8832-5e39d08af1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.733719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3287-5916-4805-8832-5e39d08af1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.735332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3287-5916-4805-8832-5e39d08af1bb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.747438 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1138/2287] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:24.751472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.759334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:24.767014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf39b-6899-4ae1-904c-d3074694e5dd admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:24.778060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:24.779019 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.779901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.780177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] PATH_INFO: `/v3/projects/5f1afbbc1233457c854e7024e25da641/users/1e1dd8ffa2044cb5813364241a26716b/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.798629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1afbbc1233457c854e7024e25da641, user_id=1e1dd8ffa2044cb5813364241a26716b, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:24.801375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:24.820169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1150/2288] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:24 2022] PUT /identity/v3/projects/5f1afbbc1233457c854e7024e25da641/users/1e1dd8ffa2044cb5813364241a26716b/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:16:24.831838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:24.832215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:24.832534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:24.848026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:24.865137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] MFA Rules not processed for user `1e1dd8ffa2044cb5813364241a26716b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:24.866510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:24.955659 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1139/2289] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:24.968368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:24.970170 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:25.048064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13461365-662a-48a3-8d8a-321534ef4bb0 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:25.052626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a0ad-14df-4f85-a1db-f7ed782113e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:25.053499 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a0ad-14df-4f85-a1db-f7ed782113e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:25.053851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a0ad-14df-4f85-a1db-f7ed782113e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:25.054130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a0ad-14df-4f85-a1db-f7ed782113e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:25.066598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02a0ad-14df-4f85-a1db-f7ed782113e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:25.068032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02a0ad-14df-4f85-a1db-f7ed782113e2 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:25.078320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1151/2290] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:27.719145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:27.784350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ee2d-58c2-4877-9114-8b49e11541c4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:27.789187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:27.790153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:27.790541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:27.790819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] PATH_INFO: `/v3/users/1e1dd8ffa2044cb5813364241a26716b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:27.792002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1dd8ffa2044cb5813364241a26716b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:27.793965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:27.871558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1dd8ffa2044cb5813364241a26716b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:27.886508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1dd8ffa2044cb5813364241a26716b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:27.887753 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1dd8ffa2044cb5813364241a26716b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:27.889320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1dd8ffa2044cb5813364241a26716b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:27.899133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1dd8ffa2044cb5813364241a26716b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:27.920391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1140/2291] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:27 2022] DELETE /identity/v3/users/1e1dd8ffa2044cb5813364241a26716b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:27.924923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:27.925617 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:27.926932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:27.945929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:27.947301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:28.011592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1152/2292] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:28.021330 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.022813 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:28.043994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:28.086793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9c00-504f-4c32-950a-5f3fa391db6d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.091287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccae69b-3283-4c1c-a0dd-aafa09ea4c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.091948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccae69b-3283-4c1c-a0dd-aafa09ea4c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.092226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccae69b-3283-4c1c-a0dd-aafa09ea4c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.092518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccae69b-3283-4c1c-a0dd-aafa09ea4c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.105023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccae69b-3283-4c1c-a0dd-aafa09ea4c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.107212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccae69b-3283-4c1c-a0dd-aafa09ea4c8c service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.117112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1141/2293] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:28.406634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.408104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:28.422192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26815996-54ad-4b98-a878-ae07366c4a01 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.427982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.429462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.429687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.429970 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] PATH_INFO: `/v3/projects/5f1afbbc1233457c854e7024e25da641` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.431509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1afbbc1233457c854e7024e25da641)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.433518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.485643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1afbbc1233457c854e7024e25da641', 'request_id': 'req-55ee9420-b314-4e1e-8c77-90720f384995'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:28.492074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1afbbc1233457c854e7024e25da641', 'request_id': 'req-55ee9420-b314-4e1e-8c77-90720f384995'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:28.502611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1afbbc1233457c854e7024e25da641', 'request_id': 'req-55ee9420-b314-4e1e-8c77-90720f384995'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:28.522509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] The token cache is being invalidate because project 5f1afbbc1233457c854e7024e25da641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:28.523111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:28.524327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-55ee9420-b314-4e1e-8c77-90720f384995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:28.526140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1153/2294] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:28 2022] DELETE /identity/v3/projects/5f1afbbc1233457c854e7024e25da641 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:28.531704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.531965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.532258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.554673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:28.555888 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:28.623522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1142/2295] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:28.631642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.632007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.632260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.640607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:28.653179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:28.655087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:28.663677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1154/2296] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:28.667845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.677800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899591c9-377e-4db5-addf-25bb296b08a3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.682818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.683420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.683696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.683965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.684689 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:16:28.684992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.686656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.698836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1143/2297] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:16:28.703057 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.713503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1086-80c9-457c-a598-84cf0d048649 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.719201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.719850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.720145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.720391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.721091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.723048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.751973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1155/2298] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:16:28 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:28.758935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.769091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb71e5f-c136-4d3c-a660-e3bf139c20a0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.826667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.827318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.827606 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.827887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.828579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.830525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.860051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1144/2299] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:16:28 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:16:28.862027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.874529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e730f1-1bf5-4070-a676-eb2fbe4a87e4 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.880015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.880824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.881167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.881566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.882842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.884674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.896822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1156/2300] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:28.901156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.911414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50410f-cd60-4596-886c-1a75d595078e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.917581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadede0d-8a8c-4666-bf2f-0bf02f4be105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.918277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadede0d-8a8c-4666-bf2f-0bf02f4be105 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.918558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadede0d-8a8c-4666-bf2f-0bf02f4be105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.918836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadede0d-8a8c-4666-bf2f-0bf02f4be105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.919569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadede0d-8a8c-4666-bf2f-0bf02f4be105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.921210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadede0d-8a8c-4666-bf2f-0bf02f4be105 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.933353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1145/2301] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:16:28.937220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:28.948050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417815-3628-47b1-980f-539ac7fd3a5d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:28.952770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:28.953692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:28.953959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:28.954223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] PATH_INFO: `/v3/projects/1a2726d0203f4d2587e3032c4373b79b/users/4dd06d3f94da4a3ea58b4da470270acf/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:28.969887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2726d0203f4d2587e3032c4373b79b, user_id=4dd06d3f94da4a3ea58b4da470270acf, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:28.972505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:28.992183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1157/2302] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:16:28 2022] PUT /identity/v3/projects/1a2726d0203f4d2587e3032c4373b79b/users/4dd06d3f94da4a3ea58b4da470270acf/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:29.008392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177e04f-1912-4b2e-9411-6f244b06941f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:29.008822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177e04f-1912-4b2e-9411-6f244b06941f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:29.009202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177e04f-1912-4b2e-9411-6f244b06941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:29.050485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3177e04f-1912-4b2e-9411-6f244b06941f None None] MFA Rules not processed for user `4dd06d3f94da4a3ea58b4da470270acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:29.051734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3177e04f-1912-4b2e-9411-6f244b06941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:29.064109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:29.166780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1146/2303] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:29.187976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:29.190394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:29.291015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91592e1a-1656-4113-8d6c-218f0c7cac4b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:29.312703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12d7e-7d71-4893-b354-be4110dff958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:29.313599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12d7e-7d71-4893-b354-be4110dff958 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:29.313975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12d7e-7d71-4893-b354-be4110dff958 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:29.314739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12d7e-7d71-4893-b354-be4110dff958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:29.324552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12d7e-7d71-4893-b354-be4110dff958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:29.326238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12d7e-7d71-4893-b354-be4110dff958 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:29.338737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1158/2304] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:30.586601 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d110df3-c823-44f4-a4c8-93a134c39cfd None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:30.587162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d110df3-c823-44f4-a4c8-93a134c39cfd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:30.587162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d110df3-c823-44f4-a4c8-93a134c39cfd None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:30.588532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1147/2305] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:16:30.595202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29566bb-aeab-4a70-8df7-6ef26c14c480 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:30.595638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29566bb-aeab-4a70-8df7-6ef26c14c480 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:30.595747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29566bb-aeab-4a70-8df7-6ef26c14c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:30.614818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d29566bb-aeab-4a70-8df7-6ef26c14c480 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:30.617031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d29566bb-aeab-4a70-8df7-6ef26c14c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:30.700655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1159/2306] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:16:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:30.712478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d110df3-c823-44f4-a4c8-93a134c39cfd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:30.714975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9d110df3-c823-44f4-a4c8-93a134c39cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:30.784743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d110df3-c823-44f4-a4c8-93a134c39cfd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:30.788819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85ddeb-00e8-4454-8896-ecead7a3765c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:30.789583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ddeb-00e8-4454-8896-ecead7a3765c service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:30.789865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ddeb-00e8-4454-8896-ecead7a3765c service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:30.790139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ddeb-00e8-4454-8896-ecead7a3765c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:30.800902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85ddeb-00e8-4454-8896-ecead7a3765c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:30.802385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85ddeb-00e8-4454-8896-ecead7a3765c service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:30.813829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1148/2307] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:30.885102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f47b4-e7da-4484-aca4-f107db9014b7 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:30.885420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f47b4-e7da-4484-aca4-f107db9014b7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:30.885717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f47b4-e7da-4484-aca4-f107db9014b7 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:30.887097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1160/2308] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:16:30.892359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ee316-84fe-4874-97d3-1415337d6ccf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:30.892707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ee316-84fe-4874-97d3-1415337d6ccf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:30.893067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ee316-84fe-4874-97d3-1415337d6ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:30.913375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3c5ee316-84fe-4874-97d3-1415337d6ccf None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:30.914683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3c5ee316-84fe-4874-97d3-1415337d6ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:30.986698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1149/2309] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:16:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:30.999658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f47b4-e7da-4484-aca4-f107db9014b7 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:31.001796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d56f47b4-e7da-4484-aca4-f107db9014b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:31.015735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f47b4-e7da-4484-aca4-f107db9014b7 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:31.019188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7c4d-d4ee-4289-9c8e-9362df280d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:31.019823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7c4d-d4ee-4289-9c8e-9362df280d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:31.020097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7c4d-d4ee-4289-9c8e-9362df280d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:31.020365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7c4d-d4ee-4289-9c8e-9362df280d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:31.027961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7c4d-d4ee-4289-9c8e-9362df280d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:31.029416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7c4d-d4ee-4289-9c8e-9362df280d68 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:31.037333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1161/2310] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:31.126776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0d91-93f8-4b49-ac7d-0915f3a809a3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:31.127148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0d91-93f8-4b49-ac7d-0915f3a809a3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:31.127532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0d91-93f8-4b49-ac7d-0915f3a809a3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:31.129394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1150/2311] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:16:31.135635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:31.136010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:31.136228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:31.156702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:31.158210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:31.174744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1162/2312] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:16:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:31.187435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d0d91-93f8-4b49-ac7d-0915f3a809a3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:31.199119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d0d91-93f8-4b49-ac7d-0915f3a809a3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:31.202810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d011a-ed7b-46ea-a71e-c8254d0eb199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:31.203450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d011a-ed7b-46ea-a71e-c8254d0eb199 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:31.203722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d011a-ed7b-46ea-a71e-c8254d0eb199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:31.203986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d011a-ed7b-46ea-a71e-c8254d0eb199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:31.215466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d011a-ed7b-46ea-a71e-c8254d0eb199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:31.217174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d011a-ed7b-46ea-a71e-c8254d0eb199 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:31.229389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1151/2313] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:34.541425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:34.579342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:34.655193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a09f6-3193-466e-8b82-3be75ca714fb None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:34.659822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:34.660735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:34.661013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:34.661341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] PATH_INFO: `/v3/users/4dd06d3f94da4a3ea58b4da470270acf` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:34.662544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd06d3f94da4a3ea58b4da470270acf)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:34.664501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:34.726137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd06d3f94da4a3ea58b4da470270acf'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:34.746527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd06d3f94da4a3ea58b4da470270acf'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:34.747299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd06d3f94da4a3ea58b4da470270acf'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:34.747907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd06d3f94da4a3ea58b4da470270acf'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:34.758935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd06d3f94da4a3ea58b4da470270acf'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:34.777452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1163/2314] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:16:34 2022] DELETE /identity/v3/users/4dd06d3f94da4a3ea58b4da470270acf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:34.778713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:34.779194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:34.779355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:34.800666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:34.802581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:34.861593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:34.882935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1152/2315] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:34.890406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:34.893215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:34.975396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1850-6040-4eac-b1b5-f15f140d877b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:34.979537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460234-0668-466f-a89f-c5c64ce68390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:34.980216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460234-0668-466f-a89f-c5c64ce68390 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:34.980492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460234-0668-466f-a89f-c5c64ce68390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:34.980762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460234-0668-466f-a89f-c5c64ce68390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:35.005260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460234-0668-466f-a89f-c5c64ce68390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:35.006964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460234-0668-466f-a89f-c5c64ce68390 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:35.019054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1164/2316] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:35.334975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:35.336475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:35.352283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69119c50-3412-4dc8-be53-31a1c297dc33 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:35.358049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:35.359185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:35.359484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:35.359761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] PATH_INFO: `/v3/projects/1a2726d0203f4d2587e3032c4373b79b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:35.361102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2726d0203f4d2587e3032c4373b79b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:35.363162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:35.416377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2726d0203f4d2587e3032c4373b79b', 'request_id': 'req-09636728-aea8-471d-b2cd-8d6db58d7923'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:35.422798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2726d0203f4d2587e3032c4373b79b', 'request_id': 'req-09636728-aea8-471d-b2cd-8d6db58d7923'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:35.429264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2726d0203f4d2587e3032c4373b79b', 'request_id': 'req-09636728-aea8-471d-b2cd-8d6db58d7923'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:35.442957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] The token cache is being invalidate because project 1a2726d0203f4d2587e3032c4373b79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:16:35.443266 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:35.443908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:16:35.445511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1153/2317] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:16:35 2022] DELETE /identity/v3/projects/1a2726d0203f4d2587e3032c4373b79b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:16:37.203855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c0ab-a7e9-4ff5-b08f-d851f44e6975 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:37.204375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c0ab-a7e9-4ff5-b08f-d851f44e6975 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:37.204375 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c0ab-a7e9-4ff5-b08f-d851f44e6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:37.223549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-21c7c0ab-a7e9-4ff5-b08f-d851f44e6975 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:37.224757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-21c7c0ab-a7e9-4ff5-b08f-d851f44e6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:37.262528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:37.290135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1165/2318] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:16:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:37.315313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:37.316781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:37.395755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09636728-aea8-471d-b2cd-8d6db58d7923 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:37.401395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:37.401770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:37.402088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:37.402308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:37.411884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:37.414068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:37.424671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1154/2319] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:16:47.282394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=8 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:47.420040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:54.902012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:54.902981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:54.902981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:54.934082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:54.935343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:55.008209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1166/2320] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:16:55.038855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:55.040690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:55.118093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc78316-b019-4fd4-87aa-f7095f13c88a service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:55.124191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:55.125105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:55.125410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:55.125695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:55.135135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:55.136743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:55.147551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1155/2321] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:55.573063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:55.574790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:55.638561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f8b6-6420-4a62-9b74-4933b58a54a5 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:55.643168 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:55.643876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:55.644130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:55.644434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:55.646635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:55.719862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:55.721425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1cb6d-2b56-46a6-beb9-0c53d0e7aeb0 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:55.731398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1167/2322] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:58.520006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:16:58.521510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:58.634990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db62f64-5696-4eba-bc43-0941254b12bc service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:16:58.640820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:16:58.641766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:58.642060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:58.642321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:58.644183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:58.657880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:16:58.659526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:16:58.669897 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1156/2323] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:16:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:16:59.958401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffe72-3a6b-4f04-94b2-2aa3cb6d7112 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:16:59.959321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffe72-3a6b-4f04-94b2-2aa3cb6d7112 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:16:59.959321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffe72-3a6b-4f04-94b2-2aa3cb6d7112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:16:59.979599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-129ffe72-3a6b-4f04-94b2-2aa3cb6d7112 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:16:59.980840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-129ffe72-3a6b-4f04-94b2-2aa3cb6d7112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:16:59.990930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1168/2324] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:00.021136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:17:00.023421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:00.039087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f739fe-db1d-48de-8381-b1ee03caa98b service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:17:00.045144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:17:00.045837 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:00.046117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:00.046568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:00.055711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:17:00.057366 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:17:00.067778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1157/2325] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:17:02.772623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a88c-88f7-43e7-96f6-8d7c1b7ab103 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:02.773144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a88c-88f7-43e7-96f6-8d7c1b7ab103 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:02.773296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a88c-88f7-43e7-96f6-8d7c1b7ab103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:02.793517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e807a88c-88f7-43e7-96f6-8d7c1b7ab103 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:02.794745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e807a88c-88f7-43e7-96f6-8d7c1b7ab103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:02.804062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1169/2326] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 20 09:17:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:02.816763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:17:02.828687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3d16-4edc-412a-8bd3-f95e36b43af9 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:17:02.835096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:17:02.835752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:02.836030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:02.836277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:02.846584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:17:02.848193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:17:02.859185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1158/2327] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:17:05.383776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059c7d7-42fd-41c2-97df-0f9827f76bf2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:05.384300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059c7d7-42fd-41c2-97df-0f9827f76bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:05.384300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059c7d7-42fd-41c2-97df-0f9827f76bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:05.406609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-8059c7d7-42fd-41c2-97df-0f9827f76bf2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:05.407905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8059c7d7-42fd-41c2-97df-0f9827f76bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:05.416946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1170/2328] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:05.445057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:17:05.459038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003431e-1d40-4b68-afdc-e078b9f1bd11 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:17:05.467582 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d759-6acb-48d2-ab66-fc0023b4064a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:17:05.468233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d759-6acb-48d2-ab66-fc0023b4064a service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:05.468509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d759-6acb-48d2-ab66-fc0023b4064a service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:05.468775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d759-6acb-48d2-ab66-fc0023b4064a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:05.478941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d759-6acb-48d2-ab66-fc0023b4064a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:17:05.480541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d759-6acb-48d2-ab66-fc0023b4064a service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:17:05.493976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1159/2329] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:17:09.888214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:09.888754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:09.888852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:09.907354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] MFA Rules not processed for user `00e5f97f0cfd48b59a8e5dc444cee670`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:09.908568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:09.936351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:09.968695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1171/2330] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:10.429407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727265-8571-401c-b389-5128fecbe944 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:10.430022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727265-8571-401c-b389-5128fecbe944 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:10.430022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727265-8571-401c-b389-5128fecbe944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:10.450248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d6727265-8571-401c-b389-5128fecbe944 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:10.451451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d6727265-8571-401c-b389-5128fecbe944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:10.462436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1160/2331] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:10.496549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:17:10.511600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242989-f192-4f30-b79c-a1c873e3e543 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:17:10.517472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:17:10.518149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:10.518418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:10.518683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:10.528099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:17:10.530145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:17:10.540135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1172/2332] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:17:14.636537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5662d79-8eea-4259-94cf-a9b283e0b487 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:14.637074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5662d79-8eea-4259-94cf-a9b283e0b487 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:14.637074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5662d79-8eea-4259-94cf-a9b283e0b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:14.658938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a5662d79-8eea-4259-94cf-a9b283e0b487 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:14.660156 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a5662d79-8eea-4259-94cf-a9b283e0b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:14.670571 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1161/2333] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:14.694257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:17:14.706488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbffc1b-b885-47ed-894c-7ed3ae8a391a service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:17:14.712712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:17:14.713403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:14.713678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:14.713949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:14.722500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:17:14.724076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:17:14.735017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1173/2334] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:17:18.919369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dcb1a-89bc-4d6a-b4fb-e738b6968f51 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:18.919993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dcb1a-89bc-4d6a-b4fb-e738b6968f51 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:18.919993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dcb1a-89bc-4d6a-b4fb-e738b6968f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:18.926721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:18.940039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8a4dcb1a-89bc-4d6a-b4fb-e738b6968f51 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:18.941704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8a4dcb1a-89bc-4d6a-b4fb-e738b6968f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:18.949942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1162/2335] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:18.973026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:17:18.984804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e88fd-6a9b-4a50-bf0e-0f4c9a98b044 service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:17:18.990840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda9e7e-6ebc-49de-92f6-994d2028fc7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:17:18.991627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda9e7e-6ebc-49de-92f6-994d2028fc7b service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:18.991971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda9e7e-6ebc-49de-92f6-994d2028fc7b service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:18.992304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda9e7e-6ebc-49de-92f6-994d2028fc7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:19.001123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda9e7e-6ebc-49de-92f6-994d2028fc7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:17:19.002914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda9e7e-6ebc-49de-92f6-994d2028fc7b service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:17:19.013160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1174/2336] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:17:28.935510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:29.008625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=29 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:37.846047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30985-c7e6-48e2-ac10-e56c90168b61 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:37.846611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30985-c7e6-48e2-ac10-e56c90168b61 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:37.846611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30985-c7e6-48e2-ac10-e56c90168b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:37.865891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5ea30985-c7e6-48e2-ac10-e56c90168b61 None None] MFA Rules not processed for user `f62ce6905cd64311ae6c2aa966d63a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:37.867107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5ea30985-c7e6-48e2-ac10-e56c90168b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:37.927783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1163/2337] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:17:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:17:47.920417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=25 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:58.830637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:17:58.831195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:17:58.831195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:17:58.850213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] MFA Rules not processed for user `5ed9d1c1ec4f419898831b7557b93693`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:17:58.851458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:17:58.910736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1175/2338] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:17:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:00.183901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26dbb4-7d6f-4193-84f1-f6b33f6ca6bc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:00.184537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26dbb4-7d6f-4193-84f1-f6b33f6ca6bc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:00.184537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26dbb4-7d6f-4193-84f1-f6b33f6ca6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:00.204208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8b26dbb4-7d6f-4193-84f1-f6b33f6ca6bc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:00.205542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8b26dbb4-7d6f-4193-84f1-f6b33f6ca6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:00.215555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1164/2339] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:00.245663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:00.259758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75335c-0486-40d7-a2ec-3731c0074cd2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:00.266533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:00.267192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:00.267472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:00.267740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:00.277119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:00.278892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:00.288962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1176/2340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:08.687535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3302ad-88a1-489e-8399-4ee30c1abc02 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:08.688472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3302ad-88a1-489e-8399-4ee30c1abc02 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:08.688754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3302ad-88a1-489e-8399-4ee30c1abc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:08.710098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dc3302ad-88a1-489e-8399-4ee30c1abc02 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:08.711624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dc3302ad-88a1-489e-8399-4ee30c1abc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:08.720038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1165/2341] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:08.743310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:08.754848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5fd6-f251-4b79-9b88-4c15f2c09e1a service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:08.761204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:08.761921 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:08.762199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:08.762476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:08.772222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:08.773918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:08.785622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1177/2342] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:12.774401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adade5b-f964-478b-b234-fc8d3828cb3e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:12.774959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adade5b-f964-478b-b234-fc8d3828cb3e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:12.775198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adade5b-f964-478b-b234-fc8d3828cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:12.798889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2adade5b-f964-478b-b234-fc8d3828cb3e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:12.800117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2adade5b-f964-478b-b234-fc8d3828cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:12.813148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1166/2343] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:12.839030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:12.852808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582df09-56f5-4e7f-8e0b-284b0a75c6b2 service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:12.863656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba71a2-4002-4ab1-9b6a-fbc5ecf6ffff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:12.864446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba71a2-4002-4ab1-9b6a-fbc5ecf6ffff service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:12.864726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba71a2-4002-4ab1-9b6a-fbc5ecf6ffff service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:12.865017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba71a2-4002-4ab1-9b6a-fbc5ecf6ffff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:12.874805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba71a2-4002-4ab1-9b6a-fbc5ecf6ffff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:12.876925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba71a2-4002-4ab1-9b6a-fbc5ecf6ffff service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:12.890319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1178/2344] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:13.586264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:13.586537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:13.586847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:13.605491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] MFA Rules not processed for user `dcf8635a22eb4c829a7a99ce4f9fb379`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:13.606759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:13.684236 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1167/2345] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:18:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:16.987033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231fe6d-5621-4a67-b125-6b2e7b845acd None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:16.987647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231fe6d-5621-4a67-b125-6b2e7b845acd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:16.987647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231fe6d-5621-4a67-b125-6b2e7b845acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:17.007939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4231fe6d-5621-4a67-b125-6b2e7b845acd None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:17.009966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4231fe6d-5621-4a67-b125-6b2e7b845acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:17.018812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1179/2346] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:17.044730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:17.057602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcb52b-2c9f-4219-80c9-fb99778e8b6e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:17.063506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:17.064164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:17.064442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:17.064716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:17.073687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:17.075355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:17.085503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1168/2347] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:21.216905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e6ad-c2ba-4ff0-97b2-dd1abe81b822 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:21.217761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e6ad-c2ba-4ff0-97b2-dd1abe81b822 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:21.217761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e6ad-c2ba-4ff0-97b2-dd1abe81b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:21.227738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=47 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:21.242192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-0010e6ad-c2ba-4ff0-97b2-dd1abe81b822 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:21.243388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-0010e6ad-c2ba-4ff0-97b2-dd1abe81b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:21.251630 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1180/2348] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Jul 20 09:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:21.294081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:21.311633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d802e84-1b16-4fc9-9a4e-c9ad4d554999 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:21.317890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:21.318544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:21.318826 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:21.319103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:21.328960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:21.330631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:21.341306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1169/2349] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:31.237008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:31.336848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=46 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:43.769467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:43.769934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:43.770030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:43.788468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] MFA Rules not processed for user `375a65c49fe843538ff349221800cf30`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:43.789677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:43.851597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1181/2350] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:18:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:49.232801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:49.234000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:49.264984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bc052-9833-4871-bb63-b81211d55d9f service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:49.270839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:49.272271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:49.272557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:49.273264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:49.275723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:49.298572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:49.302524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256566-b8f8-40d3-8b4f-096b2147498b service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:49.355757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1170/2351] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:52.688855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:52.700524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f3eb-cc76-41ca-9873-9a3cb6c80c99 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:52.705705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:52.706389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:52.706669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:52.706939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:52.708912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:52.723877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:52.725489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:52.737735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1182/2352] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:18:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:18:53.446482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:53.446984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:53.447091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:53.466320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] MFA Rules not processed for user `00e5f97f0cfd48b59a8e5dc444cee670`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:18:53.467519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:53.475177 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1171/2353] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:18:58.501787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:58.503374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:18:58.517529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549802-c931-4e10-a88e-ebe706201ac2 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:58.523218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:58.524358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:58.524688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:58.525022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] PATH_INFO: `/v3/users/f62ce6905cd64311ae6c2aa966d63a6a` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:58.526582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62ce6905cd64311ae6c2aa966d63a6a)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:58.528661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:58.581404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62ce6905cd64311ae6c2aa966d63a6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:58.594410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62ce6905cd64311ae6c2aa966d63a6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:58.595117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62ce6905cd64311ae6c2aa966d63a6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:58.596442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62ce6905cd64311ae6c2aa966d63a6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:58.603547 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-9589268b-72d8-4301-8c22-cdbe211d53b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62ce6905cd64311ae6c2aa966d63a6a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:58.622261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1183/2354] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:18:58 2022] DELETE /identity/v3/users/f62ce6905cd64311ae6c2aa966d63a6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:18:58.856477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:18:58.874326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05d08-8d0a-4733-bf1b-46b038848e09 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:18:59.005557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:18:59.006638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:18:59.006980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:18:59.007307 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] PATH_INFO: `/v3/projects/8b978c3e29c54f5dbad3a250a13fd9dd` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:18:59.008655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b978c3e29c54f5dbad3a250a13fd9dd)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:18:59.010775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:18:59.059634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b978c3e29c54f5dbad3a250a13fd9dd', 'request_id': 'req-a81305cd-b013-406e-9ab2-a2ea108bdcf3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:59.066628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b978c3e29c54f5dbad3a250a13fd9dd', 'request_id': 'req-a81305cd-b013-406e-9ab2-a2ea108bdcf3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:59.073623 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b978c3e29c54f5dbad3a250a13fd9dd', 'request_id': 'req-a81305cd-b013-406e-9ab2-a2ea108bdcf3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:59.088318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] The token cache is being invalidate because project 8b978c3e29c54f5dbad3a250a13fd9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:18:59.088610 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:59.089282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:18:59.090917 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1172/2355] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:18:58 2022] DELETE /identity/v3/projects/8b978c3e29c54f5dbad3a250a13fd9dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:03.593058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:03.594696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:03.595221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:03.616615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:03.618159 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:03.692456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1184/2356] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 20 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:03.754679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:03.756223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:03.850010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81305cd-b013-406e-9ab2-a2ea108bdcf3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:03.856042 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:03.856741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:03.857031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:03.857329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:03.873050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:03.875951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:03.883718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:03.893223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1173/2357] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:08.353864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:08.355507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:08.369768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:08.465092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a02f4-8b2c-4dcf-8542-5e0d855935e1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:08.471265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:08.472194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:08.472674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:08.472943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:08.475152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:08.555923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:08.558626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:08.571679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1185/2358] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:12.715639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:12.723149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:12.842986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c342263-eca4-4a6e-bf1d-d82336cd619b service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:12.848926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:12.850346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:12.850785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:12.851810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] PATH_INFO: `/v3/users/883a1f25631d453abbbdf55e2aa85b2d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:12.852340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883a1f25631d453abbbdf55e2aa85b2d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:12.854375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:12.918909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883a1f25631d453abbbdf55e2aa85b2d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:12.932420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883a1f25631d453abbbdf55e2aa85b2d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:12.933153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883a1f25631d453abbbdf55e2aa85b2d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:12.933783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883a1f25631d453abbbdf55e2aa85b2d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:12.941772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883a1f25631d453abbbdf55e2aa85b2d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:12.962028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1174/2359] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:19:12 2022] DELETE /identity/v3/users/883a1f25631d453abbbdf55e2aa85b2d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:13.164282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:13.180995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6506-c935-4fe2-bc47-e40737581e0c service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:13.266068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:13.267454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:13.269073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:13.269594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] PATH_INFO: `/v3/projects/10f80272ddbd4d3e99aeae46dc961843` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:13.271115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f80272ddbd4d3e99aeae46dc961843)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:13.273637 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:13.337986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f80272ddbd4d3e99aeae46dc961843', 'request_id': 'req-1c464672-9c0c-47e6-b749-bf46244d073e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.348144 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f80272ddbd4d3e99aeae46dc961843', 'request_id': 'req-1c464672-9c0c-47e6-b749-bf46244d073e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.357542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f80272ddbd4d3e99aeae46dc961843', 'request_id': 'req-1c464672-9c0c-47e6-b749-bf46244d073e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.362639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:13.379878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] The token cache is being invalidate because project 10f80272ddbd4d3e99aeae46dc961843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:19:13.380661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.381601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.385137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1186/2360] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:19:13 2022] DELETE /identity/v3/projects/10f80272ddbd4d3e99aeae46dc961843 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:13.389734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:13.391438 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:13.412274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be494f-c6cb-41c6-9579-e06e96748603 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:13.493755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:13.494688 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:13.494993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:13.495258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] PATH_INFO: `/v3/users/36f087484fc04062b91829bb5cbd1f61` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:13.496761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f087484fc04062b91829bb5cbd1f61)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:13.504340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:13.536165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:13.574645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f087484fc04062b91829bb5cbd1f61'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.590851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f087484fc04062b91829bb5cbd1f61'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.592023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f087484fc04062b91829bb5cbd1f61'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.592900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f087484fc04062b91829bb5cbd1f61'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.602000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f087484fc04062b91829bb5cbd1f61'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:13.628318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1175/2361] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:19:13 2022] DELETE /identity/v3/users/36f087484fc04062b91829bb5cbd1f61 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:13.857755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:13.859353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:13.886969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c464672-9c0c-47e6-b749-bf46244d073e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:13.971973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:13.972958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:13.973333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:13.973612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] PATH_INFO: `/v3/projects/297f1c0c63924e92840001725ff8d5af` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:13.974926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297f1c0c63924e92840001725ff8d5af)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:13.976865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:14.042895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297f1c0c63924e92840001725ff8d5af', 'request_id': 'req-84dd00e0-3b28-4894-9302-d5039cd09072'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:14.048291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297f1c0c63924e92840001725ff8d5af', 'request_id': 'req-84dd00e0-3b28-4894-9302-d5039cd09072'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:14.054930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297f1c0c63924e92840001725ff8d5af', 'request_id': 'req-84dd00e0-3b28-4894-9302-d5039cd09072'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:14.069368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] The token cache is being invalidate because project 297f1c0c63924e92840001725ff8d5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:19:14.069651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:14.070265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:14.071817 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1187/2362] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:19:13 2022] DELETE /identity/v3/projects/297f1c0c63924e92840001725ff8d5af => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:15.385416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:15.387265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:15.472850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d853b-2899-494e-96cb-30c2c527e827 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:15.542378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:15.543048 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:15.543323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:15.543593 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:15.545446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:15.579240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:15.611286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:15.612924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:15.623182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1176/2363] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:21.189443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:21.191740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:21.262730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd00e0-3b28-4894-9302-d5039cd09072 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:21.268990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:21.269975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:21.270333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:21.270655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:21.273733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:21.321349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:21.355791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:21.357487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:21.368244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1188/2364] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:25.002756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.004205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:25.019967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f2f63-d612-4302-9dd9-a1e0728d775e service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.025542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.026454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.026728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.026992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] PATH_INFO: `/v3/users/5ed9d1c1ec4f419898831b7557b93693` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.028293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed9d1c1ec4f419898831b7557b93693)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.030341 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.082777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed9d1c1ec4f419898831b7557b93693'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.096263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed9d1c1ec4f419898831b7557b93693'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.096945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed9d1c1ec4f419898831b7557b93693'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.097544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed9d1c1ec4f419898831b7557b93693'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.104332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-325865fd-e4e8-49f6-92e6-d9d2df4e0d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed9d1c1ec4f419898831b7557b93693'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.118318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1177/2365] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:19:25 2022] DELETE /identity/v3/users/5ed9d1c1ec4f419898831b7557b93693 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:25.350642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.368634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663da97-25c6-4317-b83f-556f7f94d202 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.437526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.438468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.438665 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.438936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] PATH_INFO: `/v3/projects/c0dda13a2a4f4bf48c194df9167b7cb3` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.440109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dda13a2a4f4bf48c194df9167b7cb3)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.442043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.494046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dda13a2a4f4bf48c194df9167b7cb3', 'request_id': 'req-5b5ec77b-a6fb-4134-8eca-e01042cc827d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.499457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dda13a2a4f4bf48c194df9167b7cb3', 'request_id': 'req-5b5ec77b-a6fb-4134-8eca-e01042cc827d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.505714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dda13a2a4f4bf48c194df9167b7cb3', 'request_id': 'req-5b5ec77b-a6fb-4134-8eca-e01042cc827d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.519659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] The token cache is being invalidate because project c0dda13a2a4f4bf48c194df9167b7cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:19:25.519972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.520578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5b5ec77b-a6fb-4134-8eca-e01042cc827d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:25.522192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1189/2366] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:19:25 2022] DELETE /identity/v3/projects/c0dda13a2a4f4bf48c194df9167b7cb3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:25.527335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.527624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.527903 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.546748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:25.547988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:25.614157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1178/2367] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:25.622555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.622833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.623105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.642447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:25.643676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:25.653635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1190/2368] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:25.657713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.668860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98840a-33a2-4a2c-a5c7-74c6a3bb7cfa None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.673756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.674423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.674701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.674974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.675706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:19:25.676006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.677663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.691556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1179/2369] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:19:25.696373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.707167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448c4e3-69af-47fc-8570-d3be529127fa None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.711892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.712598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.712880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.713145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.713886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.715774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.744553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1191/2370] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:19:25 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:19:25.748718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.759508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172a8ea-863c-4e35-ae6b-b5189692b4ab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.790744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:25.822365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.823047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.823328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.823597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.824289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.826276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.848274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1180/2371] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:19:25 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:19:25.852997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.863611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047577e7-da82-42fc-bb1b-e4fcb6d65b23 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.869017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.869730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.870010 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.870285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.871030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.872635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.883794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1192/2372] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:19:25.888387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.899425 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957dfef-38b5-4da1-afd4-29335a1c71c5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.905410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9991e-dc78-4a65-be88-1bb0212e5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.906079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9991e-dc78-4a65-be88-1bb0212e5d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.906357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9991e-dc78-4a65-be88-1bb0212e5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.906628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9991e-dc78-4a65-be88-1bb0212e5d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.907364 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9991e-dc78-4a65-be88-1bb0212e5d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.909025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9991e-dc78-4a65-be88-1bb0212e5d88 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.919642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1181/2373] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:19:25.925519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:25.936467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15a893-7f94-43c1-9c08-176b9d34498f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:25.941279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:25.942181 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.942474 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.942747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] PATH_INFO: `/v3/projects/4a7f86ef39624a4cbbe642c59b0027c8/users/f0117256b7b646a8b8e38adbb53b97b9/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:25.957685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7f86ef39624a4cbbe642c59b0027c8, user_id=f0117256b7b646a8b8e38adbb53b97b9, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:25.960373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:25.970014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:25.975098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1193/2374] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:19:25 2022] PUT /identity/v3/projects/4a7f86ef39624a4cbbe642c59b0027c8/users/f0117256b7b646a8b8e38adbb53b97b9/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:25.991500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:25.991734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:25.992044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.023022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] MFA Rules not processed for user `f0117256b7b646a8b8e38adbb53b97b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:26.024228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:26.094507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1182/2375] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:26.099255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.169323 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e9a53-fc79-476e-8774-8e3a8363b48d admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.174516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.175176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.175445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.175714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.176394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.178327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.211423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1194/2376] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:19:26 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:19:26.215624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.226919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca073b9-d1af-45c4-abb0-a8bbf9163ea9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.287469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.288064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.288342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.288611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.289411 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.291357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.314649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1183/2377] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:19:26 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:19:26.320557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.332446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1d0b-7e9e-4801-b0e6-fd07973c51cf admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.338876 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.339541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.339822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.340092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.340824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.343012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.357954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1195/2378] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:19:26.362555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.373663 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03e81a-b602-4fc8-afb2-1dc8c627a296 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.379176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.380077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.380353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.380622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] PATH_INFO: `/v3/projects/79be313faf06477a83e06652c1add4c4/users/aa81021c02b1446a9abce557494f1540/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.396597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79be313faf06477a83e06652c1add4c4, user_id=aa81021c02b1446a9abce557494f1540, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.399487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.415390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1184/2379] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:19:26 2022] PUT /identity/v3/projects/79be313faf06477a83e06652c1add4c4/users/aa81021c02b1446a9abce557494f1540/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:26.419359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.432979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3b04-c344-4136-9991-03b76718ecca admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.510904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd90a2-2ec5-4f8f-a39b-6759bbbcf961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.511581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd90a2-2ec5-4f8f-a39b-6759bbbcf961 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.511857 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd90a2-2ec5-4f8f-a39b-6759bbbcf961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.512171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd90a2-2ec5-4f8f-a39b-6759bbbcf961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.512908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd90a2-2ec5-4f8f-a39b-6759bbbcf961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.514571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd90a2-2ec5-4f8f-a39b-6759bbbcf961 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.525937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1196/2380] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:19:26.530206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.541888 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6a0d9-a680-4588-b3c1-0a807f73964f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.546508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.547422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.547697 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.547966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] PATH_INFO: `/v3/projects/79be313faf06477a83e06652c1add4c4/users/aa81021c02b1446a9abce557494f1540/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.549915 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79be313faf06477a83e06652c1add4c4, user_id=aa81021c02b1446a9abce557494f1540, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.552515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.555012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:26.565202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1185/2381] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:19:26 2022] PUT /identity/v3/projects/79be313faf06477a83e06652c1add4c4/users/aa81021c02b1446a9abce557494f1540/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:19:26.575531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.575819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.576090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.603991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] MFA Rules not processed for user `aa81021c02b1446a9abce557494f1540`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:26.605205 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:26.666986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:26.677387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1197/2382] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:26.690596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.698580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:26.762554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef932cf-6a0e-4433-b165-17dbe79e5d82 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.767041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.767736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.768019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.768289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.777886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.779350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.789594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1186/2383] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:26.873575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:26.884578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b08e-abd2-42f5-8c76-eb29481506d7 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:26.889137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:26.889945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:26.890290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:26.890656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:26.952339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:26.953875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:26.963648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1198/2384] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:28.949507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:28.950962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:29.029609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ff87-307e-49a4-8638-c04d12330f5e service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:29.033387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:29.034040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:29.034311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:29.034583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:29.036447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:29.046273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:29.047727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:29.056171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1187/2385] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:19:32.613538 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:32.623556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b6162-bd31-4861-86fd-0f7876003eb4 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:32.627237 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:32.627935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:32.628307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:32.628660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:32.630535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:32.640716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:32.642269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb91710-f9a9-4fa0-9dae-883ece08f5bb service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:32.650843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1199/2386] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:32.943420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:32.944911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:33.032033 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48822b1a-b2c0-4e5a-b75a-34091ce70dbf service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:33.037798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:33.038497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:33.038827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:33.039263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:33.041083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:33.052868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:33.054711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:33.065082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1188/2387] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:38.077750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:38.078289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:38.078289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:38.096613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:38.097835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:38.164969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1200/2388] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:38.177247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:38.178806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:38.213874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:38.258789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe373-0a44-46f2-ad34-5acb91a4080e service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:38.266543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:38.267295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:38.267638 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:38.268032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:38.278251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:38.279841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:38.289556 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1189/2389] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:40.824341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:40.826641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:40.933777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9784a7f-87c1-4aba-942a-aa6a3fc53ac7 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:40.944687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:40.945435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:40.945714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:40.946091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:40.947923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:40.966734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:40.968342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bd6ee-8327-4cc9-a6c4-236cdfc23abe service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:40.980115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1201/2390] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:48.139007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:48.152822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128f32a-33bc-4c99-8ee2-9f93b5e6af4b service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:48.159969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:48.160626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:48.160906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:48.161185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:48.163201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:48.226603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:48.228238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780295-97bb-46eb-a3c4-43803cd01603 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:48.237589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1190/2391] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:50.975022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:52.325652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdb1f-beb1-4b92-8813-68687e2b89bd None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.326390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdb1f-beb1-4b92-8813-68687e2b89bd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.326390 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdb1f-beb1-4b92-8813-68687e2b89bd None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.327553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1202/2392] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:19:52.335242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00596-9fe4-47f5-b071-f12e62211b51 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.335801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00596-9fe4-47f5-b071-f12e62211b51 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.336116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00596-9fe4-47f5-b071-f12e62211b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.361636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b6b00596-9fe4-47f5-b071-f12e62211b51 None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:52.363184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b6b00596-9fe4-47f5-b071-f12e62211b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:52.378748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1191/2393] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:19:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:52.386031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdb1f-beb1-4b92-8813-68687e2b89bd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:52.388776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-dddcdb1f-beb1-4b92-8813-68687e2b89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:52.468556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdb1f-beb1-4b92-8813-68687e2b89bd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:52.473831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d1a97-cf79-44ef-b1ff-ecdea961686d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:52.474494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d1a97-cf79-44ef-b1ff-ecdea961686d service glance] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.474778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d1a97-cf79-44ef-b1ff-ecdea961686d service glance] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.475054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d1a97-cf79-44ef-b1ff-ecdea961686d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.491236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d1a97-cf79-44ef-b1ff-ecdea961686d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:52.493216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d1a97-cf79-44ef-b1ff-ecdea961686d service glance] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:52.505294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1203/2394] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:52.583283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1347bbc-77be-4d02-9de4-cfba5ac698eb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.583482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1347bbc-77be-4d02-9de4-cfba5ac698eb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.583770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1347bbc-77be-4d02-9de4-cfba5ac698eb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.585285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1192/2395] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:19:52.590400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1933219-87ec-424b-b7c4-dfe84484d778 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.590677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1933219-87ec-424b-b7c4-dfe84484d778 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.590948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1933219-87ec-424b-b7c4-dfe84484d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.609746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b1933219-87ec-424b-b7c4-dfe84484d778 None None] MFA Rules not processed for user `31629ab2ee4a43a290db0875f619fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:52.611014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b1933219-87ec-424b-b7c4-dfe84484d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:52.620454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1204/2396] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:19:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:19:52.637695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1347bbc-77be-4d02-9de4-cfba5ac698eb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:52.641745 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b1347bbc-77be-4d02-9de4-cfba5ac698eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:52.660328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1347bbc-77be-4d02-9de4-cfba5ac698eb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:52.664173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581ac1-6834-4129-8ed5-1484815ae10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:52.664964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581ac1-6834-4129-8ed5-1484815ae10e service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.665252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581ac1-6834-4129-8ed5-1484815ae10e service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.665532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581ac1-6834-4129-8ed5-1484815ae10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.673653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92581ac1-6834-4129-8ed5-1484815ae10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:52.675063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92581ac1-6834-4129-8ed5-1484815ae10e service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:52.684047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1193/2397] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:19:52.778851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e94c6e-9ccd-40a5-8fe2-edd26dace754 None None] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.779345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e94c6e-9ccd-40a5-8fe2-edd26dace754 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.779861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e94c6e-9ccd-40a5-8fe2-edd26dace754 None None] PATH_INFO: `/` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.781643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1205/2398] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 20 09:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:19:52.787899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298409fb-1ea1-4e53-af57-20c9dcf63b5d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.788181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298409fb-1ea1-4e53-af57-20c9dcf63b5d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.788570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298409fb-1ea1-4e53-af57-20c9dcf63b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.810591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-298409fb-1ea1-4e53-af57-20c9dcf63b5d None None] MFA Rules not processed for user `3e99c32d943148cd8625c3ebd6c11887`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:52.811780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-298409fb-1ea1-4e53-af57-20c9dcf63b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:52.822548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1194/2399] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 20 09:19:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:52.834606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e94c6e-9ccd-40a5-8fe2-edd26dace754 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:52.848587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e94c6e-9ccd-40a5-8fe2-edd26dace754 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:52.852300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:52.852944 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:52.853217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:52.853513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:52.865296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:52.867113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:52.879370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1206/2400] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:55.155131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:55.155828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:55.156346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:55.174906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:55.176145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:55.183501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1195/2401] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:55.195285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:55.206914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c1b98-1ea1-4cf8-9c7c-ad4383a04ef7 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:55.212480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009852b-cb84-4ab1-a5f6-bef916d4732a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:55.213116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009852b-cb84-4ab1-a5f6-bef916d4732a service swift] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:55.213423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009852b-cb84-4ab1-a5f6-bef916d4732a service swift] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:55.213693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009852b-cb84-4ab1-a5f6-bef916d4732a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:55.222062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009852b-cb84-4ab1-a5f6-bef916d4732a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:55.223702 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009852b-cb84-4ab1-a5f6-bef916d4732a service swift] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:55.232004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1207/2402] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:19:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:57.467921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:57.541882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7376-7581-4d08-82e1-a49ace2985ef None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:57.546605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:57.547709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:57.547990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:57.548264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] PATH_INFO: `/v3/users/f0117256b7b646a8b8e38adbb53b97b9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:57.549492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0117256b7b646a8b8e38adbb53b97b9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:57.551445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:57.580944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:57.612796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0117256b7b646a8b8e38adbb53b97b9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:57.625633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0117256b7b646a8b8e38adbb53b97b9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:57.626367 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0117256b7b646a8b8e38adbb53b97b9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:57.626965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0117256b7b646a8b8e38adbb53b97b9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:57.633947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0117256b7b646a8b8e38adbb53b97b9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:57.649374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1196/2403] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:19:57 2022] DELETE /identity/v3/users/f0117256b7b646a8b8e38adbb53b97b9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:57.653988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:57.654476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:57.654584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:57.672646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:57.673917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:57.737645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1208/2404] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:57.748713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:57.751063 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:57.829484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036efc09-66d0-4200-be01-7a2876d94b8f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:57.833305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:57.833762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:57.834034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:57.834314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:57.844586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:57.846075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:57.857115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1197/2405] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:19:58.181450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:58.183082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:58.197090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035e7a9-333d-4e74-ba34-9a407492657a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:58.206681 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:58.208427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:58.209073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:58.209697 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] PATH_INFO: `/v3/projects/4a7f86ef39624a4cbbe642c59b0027c8` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:58.229263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7f86ef39624a4cbbe642c59b0027c8)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:58.231320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:58.324597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7f86ef39624a4cbbe642c59b0027c8', 'request_id': 'req-f1170d82-34af-47b5-895b-5dbe38e12e63'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.330855 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7f86ef39624a4cbbe642c59b0027c8', 'request_id': 'req-f1170d82-34af-47b5-895b-5dbe38e12e63'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.338238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7f86ef39624a4cbbe642c59b0027c8', 'request_id': 'req-f1170d82-34af-47b5-895b-5dbe38e12e63'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.344079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:58.359500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] The token cache is being invalidate because project 4a7f86ef39624a4cbbe642c59b0027c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:19:58.360046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.360949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.363514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1209/2406] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:19:58 2022] DELETE /identity/v3/projects/4a7f86ef39624a4cbbe642c59b0027c8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:58.367626 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:58.377800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000cdf-3d07-4393-adec-c48df22366e5 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:58.435966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:58.436889 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:58.437256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:58.437535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] PATH_INFO: `/v3/users/aa81021c02b1446a9abce557494f1540` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:58.438781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa81021c02b1446a9abce557494f1540)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:58.440725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:58.493615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa81021c02b1446a9abce557494f1540'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.494882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:58.510398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa81021c02b1446a9abce557494f1540'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.511145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa81021c02b1446a9abce557494f1540'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.511738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa81021c02b1446a9abce557494f1540'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.519940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c6cd0e87-d63a-4838-a698-0fb1b43a0ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa81021c02b1446a9abce557494f1540'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:58.551197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1198/2407] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:19:58 2022] DELETE /identity/v3/users/aa81021c02b1446a9abce557494f1540 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:19:58.939830 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:58.941580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:58.968777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170d82-34af-47b5-895b-5dbe38e12e63 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.046217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.047319 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.047598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.047871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] PATH_INFO: `/v3/projects/79be313faf06477a83e06652c1add4c4` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.049534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79be313faf06477a83e06652c1add4c4)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.051556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.106040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79be313faf06477a83e06652c1add4c4', 'request_id': 'req-4ca9717b-9989-4c72-8345-83782ad43c05'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:59.112549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79be313faf06477a83e06652c1add4c4', 'request_id': 'req-4ca9717b-9989-4c72-8345-83782ad43c05'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:59.119846 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79be313faf06477a83e06652c1add4c4', 'request_id': 'req-4ca9717b-9989-4c72-8345-83782ad43c05'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:59.139220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] The token cache is being invalidate because project 79be313faf06477a83e06652c1add4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:19:59.139553 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:59.140282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4ca9717b-9989-4c72-8345-83782ad43c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:19:59.142191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1210/2408] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:19:58 2022] DELETE /identity/v3/projects/79be313faf06477a83e06652c1add4c4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:19:59.147814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.148195 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.148476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.170005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:59.171242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:59.241718 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1199/2409] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:19:59.250735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.251020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.251299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.279460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:59.279460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:59.300973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1211/2410] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:59.305478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.324927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfd297-b17f-4e8b-bc6d-a7805418de0f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.336643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.337435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.337785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.338129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.339729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:19:59.340040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.341763 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.356182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1200/2411] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:19:59.360476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.371736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97effe9-7955-45a4-ad2c-494c1febcb01 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.376749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.377463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.377733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.377995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.378693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.380597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.408614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1212/2412] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:19:59.412693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.423223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b177c3-9070-40d6-b6ed-21ae3a86a70e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.489126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.489818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.490147 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.490415 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.491229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.493323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.516513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1201/2413] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:19:59.520717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.531764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03277f0f-52cb-4ce0-bafb-07cff2a9c60b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.537088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.538067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.538463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.538743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.539486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.541078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.556821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1213/2414] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:19:59.560695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.573746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f231750-4d9a-481c-8073-07c759a0601b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.580649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031957b-4525-4acc-9a50-d70f4c6aac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.581726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031957b-4525-4acc-9a50-d70f4c6aac67 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.582062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031957b-4525-4acc-9a50-d70f4c6aac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.582395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031957b-4525-4acc-9a50-d70f4c6aac67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.583221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031957b-4525-4acc-9a50-d70f4c6aac67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.585350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031957b-4525-4acc-9a50-d70f4c6aac67 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.598080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1202/2415] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:19:59.602280 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.612882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c69f5-d695-4577-8f88-8a8883cd6ea5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.618067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.619049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.619321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.619601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] PATH_INFO: `/v3/projects/1e906c09b1804c43af0fdbc05cddc3e9/users/2f6f6989cf124072bc4eb1e763c59381/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.640769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e906c09b1804c43af0fdbc05cddc3e9, user_id=2f6f6989cf124072bc4eb1e763c59381, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.644177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.662248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1214/2416] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:19:59 2022] PUT /identity/v3/projects/1e906c09b1804c43af0fdbc05cddc3e9/users/2f6f6989cf124072bc4eb1e763c59381/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:19:59.673353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.673639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.673913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.702225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] MFA Rules not processed for user `2f6f6989cf124072bc4eb1e763c59381`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:19:59.703965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:19:59.725406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:59.778936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1203/2417] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:19:59.783660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.807551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:59.869278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c0bc-2e34-4477-ade8-2f7e688907de admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:19:59.874431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:19:59.875113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:19:59.875394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:19:59.875670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:19:59.876488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:19:59.878676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:19:59.907011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1215/2418] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:19:59.915857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:19:59.927040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff314934-abff-4226-b8b7-eaecd922f5de None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.007158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.008185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.008485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.008754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.009479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.011449 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.041687 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1204/2419] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:19:59 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:00.045751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:00.059895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eddbb1-0afa-4afc-91d2-f4d5be1cb737 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.064664 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.065456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.065737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.066028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.066753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.068384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.080056 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1216/2420] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:20:00.084275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:00.095719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428364-d7a5-4a40-8064-b158017862c2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.100517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.101771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.102148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.102334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] PATH_INFO: `/v3/projects/e006bf22a19d4e40a4ff77f460a7febc/users/ea41d5f8fef1497e85fec9a33256eb9d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.120836 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e006bf22a19d4e40a4ff77f460a7febc, user_id=ea41d5f8fef1497e85fec9a33256eb9d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.124114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.140240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1205/2421] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:00 2022] PUT /identity/v3/projects/e006bf22a19d4e40a4ff77f460a7febc/users/ea41d5f8fef1497e85fec9a33256eb9d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:00.144246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:00.155429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51978c-d3bb-466a-89d2-60a3c07048b2 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.242661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3fc0e-5e81-497e-8126-46148707b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.243342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fc0e-5e81-497e-8126-46148707b700 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.243620 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fc0e-5e81-497e-8126-46148707b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.243904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fc0e-5e81-497e-8126-46148707b700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.244615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fc0e-5e81-497e-8126-46148707b700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.246255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fc0e-5e81-497e-8126-46148707b700 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.257562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1217/2422] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:00.261764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:00.272885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997453-75f5-458f-a01e-2ce319baf30b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.278025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.278929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.279211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.279482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] PATH_INFO: `/v3/projects/e006bf22a19d4e40a4ff77f460a7febc/users/ea41d5f8fef1497e85fec9a33256eb9d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.282933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e006bf22a19d4e40a4ff77f460a7febc, user_id=ea41d5f8fef1497e85fec9a33256eb9d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.288252 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.312751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1206/2423] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:00 2022] PUT /identity/v3/projects/e006bf22a19d4e40a4ff77f460a7febc/users/ea41d5f8fef1497e85fec9a33256eb9d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:00.324885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.325328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.325528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.359986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] MFA Rules not processed for user `ea41d5f8fef1497e85fec9a33256eb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:00.361296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:00.450587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1218/2424] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:00.462755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:00.464519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:00.532493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f13b4-484b-498d-adbf-c6dc10a91988 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.537641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.538801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.539422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.539863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.553001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.561205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.572967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1207/2425] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:00.653166 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:00.663120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889af7ee-7ff2-435c-b0b0-61b4bb2b292d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:00.666595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41709-4c8a-4fae-8644-96d5e94e6179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:00.667231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41709-4c8a-4fae-8644-96d5e94e6179 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:00.667507 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41709-4c8a-4fae-8644-96d5e94e6179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:00.667774 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41709-4c8a-4fae-8644-96d5e94e6179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:00.679910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:00.736884 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41709-4c8a-4fae-8644-96d5e94e6179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:00.738358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41709-4c8a-4fae-8644-96d5e94e6179 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:00.747794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1219/2426] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:08.159855 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:08.180494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:08.237647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7731-6dba-45a3-a9d5-ecc30df82a96 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:08.242756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:08.243933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:08.244843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:08.245190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] PATH_INFO: `/v3/users/2f6f6989cf124072bc4eb1e763c59381` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:08.246702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6f6989cf124072bc4eb1e763c59381)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:08.248947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:08.317255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6f6989cf124072bc4eb1e763c59381'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:08.338387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6f6989cf124072bc4eb1e763c59381'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:08.339166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6f6989cf124072bc4eb1e763c59381'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:08.339820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6f6989cf124072bc4eb1e763c59381'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:08.349750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6f6989cf124072bc4eb1e763c59381'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:08.378439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1208/2427] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:08 2022] DELETE /identity/v3/users/2f6f6989cf124072bc4eb1e763c59381 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:08.383085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:08.383631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:08.383631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:08.415185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:08.417416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:08.501770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1220/2428] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:08.508538 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:08.510544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:08.575740 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2f540-dcfc-402e-904c-4a8ef5abcc6f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:08.579792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:08.580464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:08.580751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:08.581019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:08.590446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:08.591890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:08.601702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1209/2429] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:08.979629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:08.981082 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:08.994211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab3b9-d709-4dd7-b5eb-937eed3c6d24 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:08.999551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:09.001367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.001646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.001919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] PATH_INFO: `/v3/projects/1e906c09b1804c43af0fdbc05cddc3e9` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.003113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e906c09b1804c43af0fdbc05cddc3e9)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:09.005838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:09.062276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e906c09b1804c43af0fdbc05cddc3e9', 'request_id': 'req-25cd7cf4-3580-44f3-98a4-3f1c35341d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.069008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e906c09b1804c43af0fdbc05cddc3e9', 'request_id': 'req-25cd7cf4-3580-44f3-98a4-3f1c35341d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.076202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e906c09b1804c43af0fdbc05cddc3e9', 'request_id': 'req-25cd7cf4-3580-44f3-98a4-3f1c35341d48'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.092435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] The token cache is being invalidate because project 1e906c09b1804c43af0fdbc05cddc3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:09.092755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.093435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.098264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1221/2430] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:08 2022] DELETE /identity/v3/projects/1e906c09b1804c43af0fdbc05cddc3e9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:09.099403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:09.110559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb8581-06e6-43d3-8612-567c59f01be0 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:09.146187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:09.173251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:09.174151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.174420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.174692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] PATH_INFO: `/v3/users/ea41d5f8fef1497e85fec9a33256eb9d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.175895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea41d5f8fef1497e85fec9a33256eb9d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:09.177868 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:09.233053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea41d5f8fef1497e85fec9a33256eb9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.249208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea41d5f8fef1497e85fec9a33256eb9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.250243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea41d5f8fef1497e85fec9a33256eb9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.250874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea41d5f8fef1497e85fec9a33256eb9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.261137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b7873644-7181-424b-9eeb-6dea463f7071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea41d5f8fef1497e85fec9a33256eb9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.278277 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1210/2431] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:09 2022] DELETE /identity/v3/users/ea41d5f8fef1497e85fec9a33256eb9d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:09.582457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:09.584087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:09.604789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd7cf4-3580-44f3-98a4-3f1c35341d48 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:09.653732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:09.685806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:09.686688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.686964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.687234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] PATH_INFO: `/v3/projects/e006bf22a19d4e40a4ff77f460a7febc` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.688520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e006bf22a19d4e40a4ff77f460a7febc)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:09.691087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:09.750792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e006bf22a19d4e40a4ff77f460a7febc', 'request_id': 'req-27fb9581-d982-4f9d-94e8-97c01f8ae14d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.757653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e006bf22a19d4e40a4ff77f460a7febc', 'request_id': 'req-27fb9581-d982-4f9d-94e8-97c01f8ae14d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.764986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e006bf22a19d4e40a4ff77f460a7febc', 'request_id': 'req-27fb9581-d982-4f9d-94e8-97c01f8ae14d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.782575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] The token cache is being invalidate because project e006bf22a19d4e40a4ff77f460a7febc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:09.782938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.783659 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-27fb9581-d982-4f9d-94e8-97c01f8ae14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:09.788878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1222/2432] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:09 2022] DELETE /identity/v3/projects/e006bf22a19d4e40a4ff77f460a7febc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:09.790747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.791116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.791453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.811327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:09.812548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:09.876852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1211/2433] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:09.885023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.885355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.885639 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.904724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:09.905978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:09.914782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1223/2434] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:09.919103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:09.929473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cd38-cd37-4812-9b8f-652e4b9e005e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:09.934894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:09.935546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.935819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.936087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.936812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:20:09.937110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:09.938736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:09.951624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1212/2435] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:20:09.956283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:09.966462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0366f9a-eb96-4798-a210-745cbd547d8d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:09.972351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:09.973051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:09.973353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:09.973621 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:09.974387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:09.976416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.005024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1224/2436] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:09 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:10.010456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.022651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b091ed-057c-4b7f-b314-ec16fef93bd1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.070046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:10.089135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.089844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.090125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.090395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.091083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.093005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.116216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1213/2437] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:10 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:10.121053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.132595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a997-fa26-405b-a8b4-0f21395989da admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.140947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.141684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.141964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.142234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.142981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.144644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.157085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1225/2438] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:10.161377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.172099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a927f-c1df-4ef2-8b47-eaa8cdf502d3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.176682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875ebd-e0e7-4ce8-a869-786a0ab7bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.177374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875ebd-e0e7-4ce8-a869-786a0ab7bc0f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.177670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875ebd-e0e7-4ce8-a869-786a0ab7bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.177942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875ebd-e0e7-4ce8-a869-786a0ab7bc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.178727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66875ebd-e0e7-4ce8-a869-786a0ab7bc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.180448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66875ebd-e0e7-4ce8-a869-786a0ab7bc0f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.191053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1214/2439] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:10.195730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.206560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5bf9a-7dbe-416e-a072-d9c3435cb321 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.212904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.213838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.214112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.214380 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] PATH_INFO: `/v3/projects/4cc2e010af4848da8a5e28eb5330a44b/users/55418ce4e5f04002a96232ed7fb3bcdf/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.229750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc2e010af4848da8a5e28eb5330a44b, user_id=55418ce4e5f04002a96232ed7fb3bcdf, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.232433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.247812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1226/2440] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:10 2022] PUT /identity/v3/projects/4cc2e010af4848da8a5e28eb5330a44b/users/55418ce4e5f04002a96232ed7fb3bcdf/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:10.259492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.259795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.260060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.292173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] MFA Rules not processed for user `55418ce4e5f04002a96232ed7fb3bcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:10.293413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:10.374549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1215/2441] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:10.386706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.388683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:10.452588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f6187-006c-48c8-9ba1-34b1cb6d8f2e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.457005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966941a-1e46-409c-a75f-3f7c75fa260b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.457667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966941a-1e46-409c-a75f-3f7c75fa260b service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.457941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966941a-1e46-409c-a75f-3f7c75fa260b service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.458207 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966941a-1e46-409c-a75f-3f7c75fa260b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.467187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966941a-1e46-409c-a75f-3f7c75fa260b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.468603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966941a-1e46-409c-a75f-3f7c75fa260b service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.477518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1227/2442] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:10.503013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.573409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965352bf-c4b7-4254-b554-c43c74d422db None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.579182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.580068 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.580343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.580612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] PATH_INFO: `/v3/users/55418ce4e5f04002a96232ed7fb3bcdf` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.582175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55418ce4e5f04002a96232ed7fb3bcdf)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.584225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.642335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55418ce4e5f04002a96232ed7fb3bcdf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:10.650959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:10.662273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55418ce4e5f04002a96232ed7fb3bcdf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:10.663374 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55418ce4e5f04002a96232ed7fb3bcdf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:10.664000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55418ce4e5f04002a96232ed7fb3bcdf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:10.674486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55418ce4e5f04002a96232ed7fb3bcdf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:10.706679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1216/2443] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:10 2022] DELETE /identity/v3/users/55418ce4e5f04002a96232ed7fb3bcdf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:10.708396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.708878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.708985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.723000 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:10.730305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:10.732148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:10.802187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1228/2444] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:20:10.812920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:10.814420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:10.894013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f30e6-f8be-4266-8a6a-462f7680fa23 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:10.899070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4bb01-ef2a-4df6-8c93-97f8cab5331d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:10.900100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4bb01-ef2a-4df6-8c93-97f8cab5331d service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:10.901394 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4bb01-ef2a-4df6-8c93-97f8cab5331d service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:10.901988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4bb01-ef2a-4df6-8c93-97f8cab5331d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:10.912743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4bb01-ef2a-4df6-8c93-97f8cab5331d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:10.914447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4bb01-ef2a-4df6-8c93-97f8cab5331d service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:10.925617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1217/2445] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:11.282433 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.284103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:11.303528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe298f1-982d-4393-8fb7-df11438b7464 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.308959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.309875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.310149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.310452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] PATH_INFO: `/v3/projects/4cc2e010af4848da8a5e28eb5330a44b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.311885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc2e010af4848da8a5e28eb5330a44b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.313859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.366489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc2e010af4848da8a5e28eb5330a44b', 'request_id': 'req-981ee4cb-883a-4dd4-8da5-337ecee3909a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:11.372926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc2e010af4848da8a5e28eb5330a44b', 'request_id': 'req-981ee4cb-883a-4dd4-8da5-337ecee3909a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:11.379315 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc2e010af4848da8a5e28eb5330a44b', 'request_id': 'req-981ee4cb-883a-4dd4-8da5-337ecee3909a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:11.392800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] The token cache is being invalidate because project 4cc2e010af4848da8a5e28eb5330a44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:11.393086 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:11.393744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-981ee4cb-883a-4dd4-8da5-337ecee3909a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:11.395342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1229/2446] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:11 2022] DELETE /identity/v3/projects/4cc2e010af4848da8a5e28eb5330a44b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:11.400646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.401155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.401155 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.420188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:11.421401 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:11.489383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1218/2447] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:11.498406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.498704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.498975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.518117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:11.519311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:11.528014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1230/2448] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:11.533070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.548867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5ca29-c69b-4e65-8632-82df5e8969f7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.557183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.557874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.558145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.558408 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.559133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:20:11.559426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.561010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.573774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1219/2449] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:20:11.578404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.588050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad6f2-4ae2-4084-aa5e-05a6936bb3de None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.595513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.596172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.596444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.596705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.597413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.599301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.630169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1231/2450] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:11 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:11.634692 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.645417 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba8229-ec57-445a-bae9-b76037b0d74f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.705105 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.705729 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.706003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.706275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.706950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.708861 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.716375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:11.730797 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1220/2451] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:11 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:11.734892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.746230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18ec2-9621-44b8-ad64-d9dc83bf4394 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.751515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.752169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.752449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.752722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.753498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.755103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.894508 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1232/2452] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:11.900776 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.912222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca233b-c49b-4f02-b6e5-ff63d712c203 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.918256 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a732cb-ab24-4696-a794-e4ed197fa74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.918960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a732cb-ab24-4696-a794-e4ed197fa74a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.919253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a732cb-ab24-4696-a794-e4ed197fa74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.919494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a732cb-ab24-4696-a794-e4ed197fa74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.920253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a732cb-ab24-4696-a794-e4ed197fa74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.922800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a732cb-ab24-4696-a794-e4ed197fa74a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.933004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1221/2453] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:11.937148 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:11.948331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98c321-0e0e-4418-911a-c94bb1b1271b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:11.953516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:11.954397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.954674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.954936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] PATH_INFO: `/v3/projects/fbcbffc34fd04d20ae906fcdb591d376/users/6d5b17bf80b64b06a1c2e409730a8e78/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:11.974820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcbffc34fd04d20ae906fcdb591d376, user_id=6d5b17bf80b64b06a1c2e409730a8e78, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:11.977683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:11.992727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1233/2454] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:11 2022] PUT /identity/v3/projects/fbcbffc34fd04d20ae906fcdb591d376/users/6d5b17bf80b64b06a1c2e409730a8e78/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:11.998185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7078d-c134-4ff3-9b13-4dc4e9a18066 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:11.998472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7078d-c134-4ff3-9b13-4dc4e9a18066 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:11.998742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7078d-c134-4ff3-9b13-4dc4e9a18066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:12.016988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-37d7078d-c134-4ff3-9b13-4dc4e9a18066 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:12.018215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-37d7078d-c134-4ff3-9b13-4dc4e9a18066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:12.082276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1222/2455] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:12.092482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:12.094320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:12.129607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:12.164401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc331-a20c-48e6-bf28-fb59093c4fc9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:12.171040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:12.171696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:12.171971 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:12.172242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:12.181905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:12.183382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:12.194157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1234/2456] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:12.359217 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348170c-e0de-4144-923f-80503c314a7c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:12.359560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348170c-e0de-4144-923f-80503c314a7c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:12.359760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348170c-e0de-4144-923f-80503c314a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:12.381784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6348170c-e0de-4144-923f-80503c314a7c None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:12.383427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6348170c-e0de-4144-923f-80503c314a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:12.449543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1223/2457] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 20 09:20:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:12.473118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:12.474635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:12.547566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f592711-5df7-468b-a971-a7dae9d94b25 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:12.553541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:12.554244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:12.554487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:12.554782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:12.565179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:12.566650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:12.575456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1235/2458] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:20:12.902375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:12.902857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:12.903304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:12.937001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] MFA Rules not processed for user `6d5b17bf80b64b06a1c2e409730a8e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:12.938329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:13.040506 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1224/2459] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:13.051705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:13.053761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:13.116759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b720a4d-671b-46c9-82ff-92b7494491cb service swift] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:13.121120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d195383-2035-4790-ba37-49f5367590de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:13.121845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195383-2035-4790-ba37-49f5367590de service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:13.122122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195383-2035-4790-ba37-49f5367590de service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:13.122385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195383-2035-4790-ba37-49f5367590de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:13.132673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d195383-2035-4790-ba37-49f5367590de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:13.134225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d195383-2035-4790-ba37-49f5367590de service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:13.146586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1236/2460] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:20:14.363444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:14.366947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:14.414437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:14.563878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e71be-feee-41f5-bd6f-ee4bc966f92b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:14.581536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:14.582295 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:14.582643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:14.582969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:14.586568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:14.622543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:14.624531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fbcf3-c51d-41d5-9c2e-425cec3a586e service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:14.626029 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:14.626843 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:14.627268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:14.644122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1225/2461] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:14.653725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] MFA Rules not processed for user `6d5b17bf80b64b06a1c2e409730a8e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:14.654936 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:14.666570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1237/2462] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:20:19.328260 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:19.328822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:19.329047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:19.353270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] MFA Rules not processed for user `00e5f97f0cfd48b59a8e5dc444cee670`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:19.354144 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:19.427141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1226/2463] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:19.775081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:19.789065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777cddf-c5b0-4028-9b57-7462ab161f2c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:19.794021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:19.795072 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:19.795410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:19.795742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:19.797653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:19.810658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:19.812467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:19.839890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1238/2464] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:24.552112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:24.553808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:24.566869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31407949-1a0e-4799-9f58-93a0d2be017d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:24.570704 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:24.571486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:24.571976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:24.572278 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:24.574212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:24.586780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:24.588471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:24.599070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1227/2465] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:24.900329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:24.902058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:24.920220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115157f6-63d2-4fc0-9545-8e2139b9b3ef service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:24.926897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:24.927560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:24.927829 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:24.928092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:24.930285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:24.943089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:24.944886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:24.956020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1239/2466] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:28.996700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:28.999104 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:29.072892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.074791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:29.094502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec877b79-cb10-42b8-a750-98a3e2469d64 service nova] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.106219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.107175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.107294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c0c6-010e-41f3-8c1e-ffd50ad1b10c service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.107486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.107746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] PATH_INFO: `/v3/users/375a65c49fe843538ff349221800cf30` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.109666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=375a65c49fe843538ff349221800cf30)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.111624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.112536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.113304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.113497 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.113767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.115577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:29.127754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.129372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.135498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:29.142190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1228/2467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:29.167365 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375a65c49fe843538ff349221800cf30'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.184185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375a65c49fe843538ff349221800cf30'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.184904 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375a65c49fe843538ff349221800cf30'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.185518 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375a65c49fe843538ff349221800cf30'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.192412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bec87cbf-0de0-4133-a330-743cd962a0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375a65c49fe843538ff349221800cf30'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.206608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1240/2468] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:29 2022] DELETE /identity/v3/users/375a65c49fe843538ff349221800cf30 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:29.390019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.405757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636edf-04a0-4a1c-bf11-b8abbd8ff0ae service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.427766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:29.470956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.471839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.472117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.472386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] PATH_INFO: `/v3/projects/43af1c2368134967b0f321700b55fb0e` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.473628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43af1c2368134967b0f321700b55fb0e)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.475539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.532273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43af1c2368134967b0f321700b55fb0e', 'request_id': 'req-88bdaf28-5b7e-499f-b69b-98d086828a02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.537857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43af1c2368134967b0f321700b55fb0e', 'request_id': 'req-88bdaf28-5b7e-499f-b69b-98d086828a02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.544133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43af1c2368134967b0f321700b55fb0e', 'request_id': 'req-88bdaf28-5b7e-499f-b69b-98d086828a02'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.558498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] The token cache is being invalidate because project 43af1c2368134967b0f321700b55fb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:29.558785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.559443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-88bdaf28-5b7e-499f-b69b-98d086828a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:29.561069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1229/2469] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:29 2022] DELETE /identity/v3/projects/43af1c2368134967b0f321700b55fb0e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:29.566246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.566544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.566803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.586426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:29.587672 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:29.649158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1241/2470] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:29.657885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.658164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.658432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.679785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:29.681160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:29.690422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1230/2471] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:29.694814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.705431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e698-b1f2-452a-b069-bbb329495b35 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.710832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.711491 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.712007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.712314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.713045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:20:29.713465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.715110 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.727312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1242/2472] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:20:29.731978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.743232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e75df-f1bd-43c2-a1f8-e9d2a7b88623 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.749168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.749873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.750150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.750419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.751170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.753067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.783273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1231/2473] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:29 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:29.787717 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.798634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893bad-48e6-4409-8bf4-c15c1c49c8d5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.862867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.864190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.864675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.864950 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.865710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.867985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.894565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1243/2474] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:29 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:29.900728 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.916957 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d32b-c6c9-4422-8354-9fc5b176bc31 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.924849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.925909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.926510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.927010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.927975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.930365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.956951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1232/2475] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:29.961472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:29.973937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b283b8-b5db-4f01-9a02-8130311465d6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:29.980117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cb350-c2bd-4993-82e9-088e9d2903e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:29.980799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb350-c2bd-4993-82e9-088e9d2903e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:29.981076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb350-c2bd-4993-82e9-088e9d2903e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:29.981447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb350-c2bd-4993-82e9-088e9d2903e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:29.982105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cb350-c2bd-4993-82e9-088e9d2903e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:29.983752 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cb350-c2bd-4993-82e9-088e9d2903e7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:29.995223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1244/2476] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:29.999612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.010916 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac734f-9282-4fbc-8b68-f3482fb5b2e2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.015935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.016840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.017115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.017423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] PATH_INFO: `/v3/projects/2e9e0094d8d64aa2b13e2e56fd43fafd/users/3089b0473850410a86fc860239abee25/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.034603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9e0094d8d64aa2b13e2e56fd43fafd, user_id=3089b0473850410a86fc860239abee25, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.037281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.053862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1233/2477] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:29 2022] PUT /identity/v3/projects/2e9e0094d8d64aa2b13e2e56fd43fafd/users/3089b0473850410a86fc860239abee25/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:30.064472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.064839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.065320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.079608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:30.095600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] MFA Rules not processed for user `3089b0473850410a86fc860239abee25`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:30.097069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:30.164268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1245/2478] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:30.168870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.221324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:30.238170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be97e21-1373-441e-ab9b-21ccd18b4276 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.242971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.243737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.244016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.244290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.244984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.246954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.274561 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1234/2479] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:30 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:30.279149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.290020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c3b72-60b2-492d-b5e3-b91f393ecd03 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.355749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.356419 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.356687 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.356954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.357666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.359613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.380695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1246/2480] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:30 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:30.384862 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.395721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d7117-7ed0-4e33-a9d0-8200f997c198 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.401043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.401933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.402179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.402452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.403171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.404967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.416458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1235/2481] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:30.420588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.430447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ff1a-fa35-4bd9-bd29-7f910e0cce28 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.435513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.436533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.436786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.437052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] PATH_INFO: `/v3/projects/e754a577f9714531a6882e532a63dea9/users/3b42dbfbc2ef43a189cfa1bf91c3dc47/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.453256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e754a577f9714531a6882e532a63dea9, user_id=3b42dbfbc2ef43a189cfa1bf91c3dc47, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.455905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.470093 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1247/2482] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:30 2022] PUT /identity/v3/projects/e754a577f9714531a6882e532a63dea9/users/3b42dbfbc2ef43a189cfa1bf91c3dc47/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:30.474189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.484733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220f80-2d3e-4f86-993c-893512cfe09b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.558201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c466f-7b9e-4cd6-bc83-8da2b7826081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.559060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c466f-7b9e-4cd6-bc83-8da2b7826081 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.559438 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c466f-7b9e-4cd6-bc83-8da2b7826081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.559934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c466f-7b9e-4cd6-bc83-8da2b7826081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.560838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c466f-7b9e-4cd6-bc83-8da2b7826081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.562605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c466f-7b9e-4cd6-bc83-8da2b7826081 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.573646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1236/2483] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:30.578194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.589264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df785-c459-48be-951b-91b373364ec3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.596215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.597481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.597865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.598327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] PATH_INFO: `/v3/projects/e754a577f9714531a6882e532a63dea9/users/3b42dbfbc2ef43a189cfa1bf91c3dc47/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.600434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e754a577f9714531a6882e532a63dea9, user_id=3b42dbfbc2ef43a189cfa1bf91c3dc47, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.603793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.617284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1248/2484] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:30 2022] PUT /identity/v3/projects/e754a577f9714531a6882e532a63dea9/users/3b42dbfbc2ef43a189cfa1bf91c3dc47/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:30.628890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183a62-b13b-4cce-a934-5246a5f22fa9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.629180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183a62-b13b-4cce-a934-5246a5f22fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.629490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183a62-b13b-4cce-a934-5246a5f22fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.657205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cf183a62-b13b-4cce-a934-5246a5f22fa9 None None] MFA Rules not processed for user `3b42dbfbc2ef43a189cfa1bf91c3dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:30.658461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cf183a62-b13b-4cce-a934-5246a5f22fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:30.730240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1237/2485] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:30.742453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:30.744626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:30.809603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:30.814765 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68583e-ec48-4419-a8a3-d89a26d04a35 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:30.821690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:30.822467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:30.822757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:30.823034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:30.881539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:30.883013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:30.892812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1249/2486] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:32.199312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:32.199835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:32.199835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:32.218499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] MFA Rules not processed for user `6d5b17bf80b64b06a1c2e409730a8e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:32.219736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:32.265161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:32.285998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1238/2487] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:33.551227 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:33.561716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121f1e-6671-42f3-9260-9f0a6f0e216b service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:33.566938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340a1dd-6233-4150-8e49-7d794e5b30d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:33.568954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340a1dd-6233-4150-8e49-7d794e5b30d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:33.569490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340a1dd-6233-4150-8e49-7d794e5b30d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:33.569822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340a1dd-6233-4150-8e49-7d794e5b30d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:33.582101 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340a1dd-6233-4150-8e49-7d794e5b30d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:33.583663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340a1dd-6233-4150-8e49-7d794e5b30d6 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:33.606638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1250/2488] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:42.275161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:43.590435 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=32 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:46.409208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:46.480823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a739b-88c8-445b-b21a-b867c01e810f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:46.487310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:46.488255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:46.488530 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:46.488800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] PATH_INFO: `/v3/users/3089b0473850410a86fc860239abee25` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:46.490092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3089b0473850410a86fc860239abee25)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:46.492023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:46.544249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3089b0473850410a86fc860239abee25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:46.556435 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3089b0473850410a86fc860239abee25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:46.557142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3089b0473850410a86fc860239abee25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:46.557765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3089b0473850410a86fc860239abee25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:46.565014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3089b0473850410a86fc860239abee25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:46.580778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1239/2489] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:46 2022] DELETE /identity/v3/users/3089b0473850410a86fc860239abee25 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:46.585534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:46.586055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:46.586055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:46.604200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:46.605479 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:46.669410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1251/2490] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:46.679424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:46.680950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:46.740757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6f4ed-1bb3-4bf7-b5c0-5d7e4ee1c511 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:46.744670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:46.745347 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:46.745641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:46.745909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:46.756320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:46.757818 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:46.768508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1240/2491] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:47.070278 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:47.072673 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:47.089557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc235-183b-4a71-a8c8-2e3e5e3a89ff None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:47.094578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:47.095477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:47.095758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:47.096035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] PATH_INFO: `/v3/projects/2e9e0094d8d64aa2b13e2e56fd43fafd` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:47.097247 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9e0094d8d64aa2b13e2e56fd43fafd)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:47.099273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:47.158087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9e0094d8d64aa2b13e2e56fd43fafd', 'request_id': 'req-cb50a560-1548-4fc7-b343-d89b56234382'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.165094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9e0094d8d64aa2b13e2e56fd43fafd', 'request_id': 'req-cb50a560-1548-4fc7-b343-d89b56234382'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.172389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9e0094d8d64aa2b13e2e56fd43fafd', 'request_id': 'req-cb50a560-1548-4fc7-b343-d89b56234382'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.186964 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] The token cache is being invalidate because project 2e9e0094d8d64aa2b13e2e56fd43fafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:47.187343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.188102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.190088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1252/2492] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:47 2022] DELETE /identity/v3/projects/2e9e0094d8d64aa2b13e2e56fd43fafd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:47.194275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:47.204785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5222-4fee-48f3-a82b-80d9d1842042 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:47.225422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:47.267379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:47.268271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:47.268559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:47.268823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] PATH_INFO: `/v3/users/3b42dbfbc2ef43a189cfa1bf91c3dc47` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:47.270022 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b42dbfbc2ef43a189cfa1bf91c3dc47)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:47.271934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:47.330951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b42dbfbc2ef43a189cfa1bf91c3dc47'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.343976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b42dbfbc2ef43a189cfa1bf91c3dc47'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.344964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b42dbfbc2ef43a189cfa1bf91c3dc47'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.345608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b42dbfbc2ef43a189cfa1bf91c3dc47'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.353092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-139261dc-c44c-40ab-b1fa-0fbe858e1ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b42dbfbc2ef43a189cfa1bf91c3dc47'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.368319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1241/2493] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:47 2022] DELETE /identity/v3/users/3b42dbfbc2ef43a189cfa1bf91c3dc47 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:47.645738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:47.648516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:47.666550 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a560-1548-4fc7-b343-d89b56234382 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:47.729808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:47.731049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:47.731376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:47.731644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] PATH_INFO: `/v3/projects/e754a577f9714531a6882e532a63dea9` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:47.732935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e754a577f9714531a6882e532a63dea9)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:47.735225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:47.772250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:47.790214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e754a577f9714531a6882e532a63dea9', 'request_id': 'req-f5703c32-e192-40d3-8147-ca8962217d78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.796352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e754a577f9714531a6882e532a63dea9', 'request_id': 'req-f5703c32-e192-40d3-8147-ca8962217d78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.803797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e754a577f9714531a6882e532a63dea9', 'request_id': 'req-f5703c32-e192-40d3-8147-ca8962217d78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.818295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] The token cache is being invalidate because project e754a577f9714531a6882e532a63dea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:47.818755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.819724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-f5703c32-e192-40d3-8147-ca8962217d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:47.822434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1253/2494] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:47 2022] DELETE /identity/v3/projects/e754a577f9714531a6882e532a63dea9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:47.828420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:47.828927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:47.829064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:47.848349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:47.849598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:47.914587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1242/2495] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:47.923338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:47.923625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:47.923980 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:47.953262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:47.954509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:47.964039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1254/2496] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:47.970779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:47.985216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333440f2-d7fc-4799-8a15-e86f4c57cadd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:47.990854 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:47.991518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:47.991796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:47.992066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:47.992788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:20:47.993119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:47.994788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.007504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1243/2497] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:20:48.012486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.022530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04980bc0-fcb1-4657-a898-c457922da7bb None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.027440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.028077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.028343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.028606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.029368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.031483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.064036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1255/2498] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:48 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:20:48.069652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.081204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afda26-7380-479e-a2eb-146351b6b4f5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.110044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:48.146139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.147500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.147781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.148055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.148751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.150768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.174306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1244/2499] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:48 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:48.178386 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.189521 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be376b32-9ca9-4ba4-8818-390341785a0c admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.194652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.195364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.195645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.195919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.196652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.198608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.209835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1256/2500] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:20:48.213920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.224336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a167-8aab-4695-bf4d-294128f7b602 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.229075 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adc7e-0100-4113-a10e-19fe9f7c5004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.229969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adc7e-0100-4113-a10e-19fe9f7c5004 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.230335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adc7e-0100-4113-a10e-19fe9f7c5004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.230674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adc7e-0100-4113-a10e-19fe9f7c5004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.231468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adc7e-0100-4113-a10e-19fe9f7c5004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.233635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adc7e-0100-4113-a10e-19fe9f7c5004 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.249932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1245/2501] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:48.251105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.261580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c329b-6844-41c1-b036-9112f47cff91 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.266424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.267310 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.267585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.267853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] PATH_INFO: `/v3/projects/59b178a1d5944bcfbe2112e63549234c/users/bcb29dfe645f42438dc94e0aa0181497/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.282487 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b178a1d5944bcfbe2112e63549234c, user_id=bcb29dfe645f42438dc94e0aa0181497, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.285145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.301062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1257/2502] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:48 2022] PUT /identity/v3/projects/59b178a1d5944bcfbe2112e63549234c/users/bcb29dfe645f42438dc94e0aa0181497/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:48.311941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.312223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.312493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.467649 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] MFA Rules not processed for user `bcb29dfe645f42438dc94e0aa0181497`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:48.468806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:48.542351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1246/2503] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:48.547696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.624544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baaa4d-9f10-42a8-aa53-dd2e6761388f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.630488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009fd4-6e1c-4f03-8dae-fca610eddb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.631063 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009fd4-6e1c-4f03-8dae-fca610eddb2e admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.631311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009fd4-6e1c-4f03-8dae-fca610eddb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.631799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009fd4-6e1c-4f03-8dae-fca610eddb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.632302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10009fd4-6e1c-4f03-8dae-fca610eddb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.634271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10009fd4-6e1c-4f03-8dae-fca610eddb2e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.666666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1258/2504] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:48 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:48.669720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.679403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.679685 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.679959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.682929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16418995-cf99-4e2a-a476-feea8efc5339 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.697868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:48.699080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:48.739988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:48.757849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.758604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.759017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.759456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.760369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.763096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.770226 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1259/2505] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:20:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:20:48.783888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.786001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:48.793508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1247/2506] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:48 2022] POST /identity/v3/users => generated 306 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:48.794540 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.806628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2456f-3516-4ba9-b77d-0bd6b8745032 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.811613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.812359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.812706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.813046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.814225 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.815901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.830773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1248/2507] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:48.832702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.845699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82c58-bb3d-4911-bb33-a163253ce599 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.850590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.851589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.851936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.852275 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] PATH_INFO: `/v3/projects/8eeafcf0cc114f78b2a1d7707b37277d/users/25fb8530256541e698ef705580aa2a00/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.868987 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:48.877760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeafcf0cc114f78b2a1d7707b37277d, user_id=25fb8530256541e698ef705580aa2a00, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.882050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.886716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53611e95-dd61-483b-942d-ffce7f53cf26 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:48.893100 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:48.893905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:48.894251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:48.894585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:48.897490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1249/2508] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:48 2022] PUT /identity/v3/projects/8eeafcf0cc114f78b2a1d7707b37277d/users/25fb8530256541e698ef705580aa2a00/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:48.901572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:48.907882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:48.909671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:48.918998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1260/2509] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:20:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:20:49.004699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e19e6-957c-410b-8212-0c11573006a6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:49.010231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3ff99-29a4-4df5-9a71-269406d52060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:49.010879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3ff99-29a4-4df5-9a71-269406d52060 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:49.011412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3ff99-29a4-4df5-9a71-269406d52060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:49.011412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3ff99-29a4-4df5-9a71-269406d52060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:49.012280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3ff99-29a4-4df5-9a71-269406d52060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:49.014035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3ff99-29a4-4df5-9a71-269406d52060 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:49.025755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1250/2510] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:49.031285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:49.054707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50367-8575-4b18-ac25-f9d2240c4687 service swift] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:49.060686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:49.061819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:49.062075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:49.062333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] PATH_INFO: `/v3/projects/8eeafcf0cc114f78b2a1d7707b37277d/users/25fb8530256541e698ef705580aa2a00/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:49.064952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeafcf0cc114f78b2a1d7707b37277d, user_id=25fb8530256541e698ef705580aa2a00, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:49.067907 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:49.080932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1261/2511] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:49 2022] PUT /identity/v3/projects/8eeafcf0cc114f78b2a1d7707b37277d/users/25fb8530256541e698ef705580aa2a00/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:49.092999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:49.093358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:49.093572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:49.126407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] MFA Rules not processed for user `25fb8530256541e698ef705580aa2a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:49.127647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:49.249487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1251/2512] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:49.270543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:49.274161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:49.357202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f3d09-4122-4db1-9873-9e27167870ab admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:49.361953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:49.362619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:49.362896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:49.363162 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:49.379703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:49.385998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:49.400416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1262/2513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:49.577652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:49.590946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e08dfd-8cc6-4be1-8906-09fc22cd9899 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:49.597519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:49.598551 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:49.598840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:49.599349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:49.678522 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:49.680025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:49.709501 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1252/2514] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:54.313446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:54.316004 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:54.403424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918b29-cff8-4684-af0e-66df259bab66 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:54.408462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:54.409264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:54.409949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:54.411222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:54.413527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:54.434163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:54.472677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:54.489283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:54.515490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:54.520616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35900e-ca81-477d-8cb2-8c1d77a9d162 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:54.543786 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1263/2515] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:54.564725 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ebbac-3fa9-4a10-bab2-79497482c523 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:54.575361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:54.578492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:54.578858 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:54.579337 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] PATH_INFO: `/v3/users/bcb29dfe645f42438dc94e0aa0181497` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:54.581153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb29dfe645f42438dc94e0aa0181497)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:54.583995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:54.662544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb29dfe645f42438dc94e0aa0181497'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:54.686746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb29dfe645f42438dc94e0aa0181497'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:54.687531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb29dfe645f42438dc94e0aa0181497'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:54.688114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb29dfe645f42438dc94e0aa0181497'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:54.698761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb29dfe645f42438dc94e0aa0181497'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:54.720823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1253/2516] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:54 2022] DELETE /identity/v3/users/bcb29dfe645f42438dc94e0aa0181497 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:54.725471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:54.725945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:54.726223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:54.752236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:54.754070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:54.831735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1264/2517] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:54.843381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:54.845269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:54.926196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e804c-e186-4409-bfd6-0f187a69f1fe admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:54.931863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:54.932544 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:54.932835 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:54.933092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:54.945368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:54.946863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:54.959657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1254/2518] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:55.503334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:55.505021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:55.524616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266a972-0ba1-4c39-92fc-ce197f28db66 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:55.530832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:55.530832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:55.530832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:55.530832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] PATH_INFO: `/v3/projects/59b178a1d5944bcfbe2112e63549234c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:55.533279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b178a1d5944bcfbe2112e63549234c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:55.535395 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:55.619802 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b178a1d5944bcfbe2112e63549234c', 'request_id': 'req-a395f25e-b0f1-498a-9468-d344ee2b722e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.629696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b178a1d5944bcfbe2112e63549234c', 'request_id': 'req-a395f25e-b0f1-498a-9468-d344ee2b722e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.638303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b178a1d5944bcfbe2112e63549234c', 'request_id': 'req-a395f25e-b0f1-498a-9468-d344ee2b722e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.657106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] The token cache is being invalidate because project 59b178a1d5944bcfbe2112e63549234c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:55.658012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.659524 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.661592 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1265/2519] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:55 2022] DELETE /identity/v3/projects/59b178a1d5944bcfbe2112e63549234c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:55.665878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:55.676338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972dc4-85ac-41bb-901b-3db114491dca service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:55.713107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:55.754492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:55.755399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:55.755681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:55.756005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] PATH_INFO: `/v3/users/25fb8530256541e698ef705580aa2a00` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:55.758318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fb8530256541e698ef705580aa2a00)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:55.760044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:55.839507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fb8530256541e698ef705580aa2a00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.856158 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fb8530256541e698ef705580aa2a00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.857010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fb8530256541e698ef705580aa2a00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.857946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fb8530256541e698ef705580aa2a00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.868777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fffb0560-9e09-4fa6-b870-2a514432b0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fb8530256541e698ef705580aa2a00'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:55.888441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1255/2520] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:55 2022] DELETE /identity/v3/users/25fb8530256541e698ef705580aa2a00 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:56.365287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:56.365287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:56.401065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f25e-b0f1-498a-9468-d344ee2b722e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:56.445519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:56.478143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:56.479163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:56.479511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:56.480215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] PATH_INFO: `/v3/projects/8eeafcf0cc114f78b2a1d7707b37277d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:56.481604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeafcf0cc114f78b2a1d7707b37277d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:56.484634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:56.567512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeafcf0cc114f78b2a1d7707b37277d', 'request_id': 'req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:56.573746 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeafcf0cc114f78b2a1d7707b37277d', 'request_id': 'req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:56.581813 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeafcf0cc114f78b2a1d7707b37277d', 'request_id': 'req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:56.604503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] The token cache is being invalidate because project 8eeafcf0cc114f78b2a1d7707b37277d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:20:56.604725 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:56.605477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c3f43bf4-a4ff-4cfd-9b14-b9a8aefbf67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:20:56.607831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1266/2521] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:20:56 2022] DELETE /identity/v3/projects/8eeafcf0cc114f78b2a1d7707b37277d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:56.613083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:56.613511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:56.613914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:56.643129 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:56.645146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:56.733513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1256/2522] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:56.744043 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:56.744320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:56.744699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:56.768844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:56.770314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:56.786553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:56.798251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1267/2523] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:56.800125 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d85ec-2733-41c4-bf2f-dc73dce2e823 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:56.806212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:56.806978 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:56.807269 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:56.807595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:56.808352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:20:56.808666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:56.810670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:56.834259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:56.841830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1257/2524] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:20:56.847139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ebda-a51c-48ad-8c3e-bae972e31b24 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:56.852779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:56.856055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:56.856055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:56.856055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:56.856055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:56.859475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:56.921651 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1268/2525] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:56 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:56.927808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:56.966545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b57d-a9e9-447c-98d0-4d08978e250f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.035354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:57.096316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.098473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.099455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.099983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.101979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.106035 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.157679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1258/2526] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:56 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:57.158081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.172216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af944-9e03-4ce9-bfeb-837442dba047 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.185328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.186688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.187045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.188005 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.188962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.192957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.213145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.219953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1269/2527] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:20:57.226081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490e88-f25e-43f0-907b-3fc120fb35d1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.231921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043400b0-5844-450a-a3b2-2f40ae4e4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.233196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043400b0-5844-450a-a3b2-2f40ae4e4ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.233427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043400b0-5844-450a-a3b2-2f40ae4e4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.233935 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043400b0-5844-450a-a3b2-2f40ae4e4ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.235011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043400b0-5844-450a-a3b2-2f40ae4e4ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.236777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043400b0-5844-450a-a3b2-2f40ae4e4ee9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.263061 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1259/2528] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:57.268409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.282149 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992ed6-23b3-4bab-a0f2-da512795aa58 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.287510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.288587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.288956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.289360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] PATH_INFO: `/v3/projects/9d39c6b54b7647158044a39d6408c3b6/users/762706c874ee41a080beb92d4eb5c81a/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.315885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d39c6b54b7647158044a39d6408c3b6, user_id=762706c874ee41a080beb92d4eb5c81a, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.318978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.381313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1270/2529] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:57 2022] PUT /identity/v3/projects/9d39c6b54b7647158044a39d6408c3b6/users/762706c874ee41a080beb92d4eb5c81a/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:20:57.383416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.383780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.384131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.422074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] MFA Rules not processed for user `762706c874ee41a080beb92d4eb5c81a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:57.424041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:57.507884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1260/2530] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:57.512337 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.618779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354785-2f89-4192-9443-bbe172e756ca admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.634838 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.636544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.637140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.637632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.639035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.643999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.652317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:57.703229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1271/2531] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:20:57 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:57.710285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.734381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389de65-012a-42eb-878e-6a9439f84186 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.852187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.853611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.854089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.854537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.855446 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.857906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.903678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1261/2532] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:20:57 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:20:57.904283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.917115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b049b-b2c5-440b-8070-c23f818cae36 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.924588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.925316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.925593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.925868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:57.926614 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:57.930418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:57.943897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1272/2533] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:20:57.947979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:57.968630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40384cc3-e7b3-4504-b557-4908fa1f27d4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:57.979452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:57.980666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:57.981050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:57.981475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] PATH_INFO: `/v3/projects/2fc411e1298c4eee998585345282f050/users/4069ff2fd47b46228850fd3a25f3a2c6/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:58.025054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc411e1298c4eee998585345282f050, user_id=4069ff2fd47b46228850fd3a25f3a2c6, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:58.027928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:58.053315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1262/2534] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:57 2022] PUT /identity/v3/projects/2fc411e1298c4eee998585345282f050/users/4069ff2fd47b46228850fd3a25f3a2c6/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:58.056024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:58.067259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf965b-9e0a-468b-a003-689273c53af3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:58.200331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db741372-a915-4f59-bfc1-1cc7bcdc710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:58.200331 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741372-a915-4f59-bfc1-1cc7bcdc710b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:58.200778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741372-a915-4f59-bfc1-1cc7bcdc710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:58.201179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741372-a915-4f59-bfc1-1cc7bcdc710b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:58.202799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db741372-a915-4f59-bfc1-1cc7bcdc710b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:58.205612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db741372-a915-4f59-bfc1-1cc7bcdc710b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:58.224646 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1273/2535] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:20:58.226199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:58.251222 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b632-ce43-4f96-a5ae-21c74dab6fb0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:58.258381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:58.260005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:58.260908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:58.261550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] PATH_INFO: `/v3/projects/2fc411e1298c4eee998585345282f050/users/4069ff2fd47b46228850fd3a25f3a2c6/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:58.264421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc411e1298c4eee998585345282f050, user_id=4069ff2fd47b46228850fd3a25f3a2c6, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:58.267650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:58.278865 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:58.289442 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1263/2536] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:20:58 2022] PUT /identity/v3/projects/2fc411e1298c4eee998585345282f050/users/4069ff2fd47b46228850fd3a25f3a2c6/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:20:58.309330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:58.309749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:58.310276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:58.377120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] MFA Rules not processed for user `4069ff2fd47b46228850fd3a25f3a2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:20:58.377120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:58.478422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1274/2537] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:20:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:20:58.492962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:58.494864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:58.578985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69d71-3312-4095-ab35-f94fac7dcefa admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:58.583487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:58.584732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:58.586439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:58.586439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:58.598748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:58.600326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:58.613758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1264/2538] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:58.774706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:58.790160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed54a-f348-4c32-ab05-15469e284502 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:58.798338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:58.799028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:58.800483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:58.800850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:58.882925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:58.893869 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:58.895616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:20:58.908340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1275/2539] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:20:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:20:59.832778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:20:59.834549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:20:59.952529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f76f-7989-4ecb-8163-c65bfdb3a3bd service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:20:59.960030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:20:59.961631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:20:59.962900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:20:59.963640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] PATH_INFO: `/v3/users/dcf8635a22eb4c829a7a99ce4f9fb379` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:20:59.967134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf8635a22eb4c829a7a99ce4f9fb379)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:20:59.970830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:00.049608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf8635a22eb4c829a7a99ce4f9fb379'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.081902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf8635a22eb4c829a7a99ce4f9fb379'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.083037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf8635a22eb4c829a7a99ce4f9fb379'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.083755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf8635a22eb4c829a7a99ce4f9fb379'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.095930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ffd55ea2-7dfa-4656-8ba7-af1cb7a78b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf8635a22eb4c829a7a99ce4f9fb379'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.119336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1265/2540] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:20:59 2022] DELETE /identity/v3/users/dcf8635a22eb4c829a7a99ce4f9fb379 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:00.339771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:00.356443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb289-574e-4c81-96ab-26df8104a36f service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:00.439466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:00.440367 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:00.440648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:00.440923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] PATH_INFO: `/v3/projects/a205848753ba47158b59ebee3fffa81d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:00.442228 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a205848753ba47158b59ebee3fffa81d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:00.444222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:00.506108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a205848753ba47158b59ebee3fffa81d', 'request_id': 'req-b94a97a7-376a-418c-8402-c492d1a041d5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.520634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a205848753ba47158b59ebee3fffa81d', 'request_id': 'req-b94a97a7-376a-418c-8402-c492d1a041d5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.534966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a205848753ba47158b59ebee3fffa81d', 'request_id': 'req-b94a97a7-376a-418c-8402-c492d1a041d5'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.572128 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] The token cache is being invalidate because project a205848753ba47158b59ebee3fffa81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:00.572440 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.573138 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b94a97a7-376a-418c-8402-c492d1a041d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:00.574824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1276/2541] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:00 2022] DELETE /identity/v3/projects/a205848753ba47158b59ebee3fffa81d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:00.581208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:00.581884 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:00.582239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:00.604825 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:00.606020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:00.655040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:00.738382 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1266/2542] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:00.746834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:00.747125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:00.747411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:00.774411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:00.775584 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:00.796151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:00.796946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1277/2543] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:00.808527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52039df4-ba51-4689-87bc-10c9b15e5cf0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:00.821911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:00.822912 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:00.823333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:00.823752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:00.824647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:00.824948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:00.827397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:00.844990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1267/2544] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:00.848770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:00.860488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99049283-3814-4e3e-a1c4-3118051acd47 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:00.865981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:00.866657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:00.866933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:00.867198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:00.867928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:00.869959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:00.900732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1278/2545] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:00 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:00.905025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:00.917510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3425d-48d1-460b-bd0e-c26e8a69517a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:00.991675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:00.992375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:00.992703 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:00.992928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:00.993783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:00.995998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:01.021290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1268/2546] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:00 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:01.024344 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:01.040387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e03df-bdab-4b8b-8e07-5865f4b06fae admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:01.045954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:01.046917 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:01.047294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:01.047684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:01.048657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:01.050492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:01.064956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1279/2547] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:01.066379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:01.077789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c67d4-235b-4740-8e27-6e4f1523a87f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:01.082831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848493b7-c1e9-4d4e-b561-74a1bfe166da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:01.083577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848493b7-c1e9-4d4e-b561-74a1bfe166da admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:01.083958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848493b7-c1e9-4d4e-b561-74a1bfe166da admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:01.084267 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848493b7-c1e9-4d4e-b561-74a1bfe166da admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:01.085089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848493b7-c1e9-4d4e-b561-74a1bfe166da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:01.086932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848493b7-c1e9-4d4e-b561-74a1bfe166da admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:01.101381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1269/2548] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:01.105355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:01.115916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029fc6f-97f9-4266-92c6-30d1d071e280 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:01.120719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:01.121767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:01.122178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:01.122350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] PATH_INFO: `/v3/projects/cd117a4989974de6a548f647fecc8af1/users/9ae99c1f581342bbaa42647265728a79/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:01.140509 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd117a4989974de6a548f647fecc8af1, user_id=9ae99c1f581342bbaa42647265728a79, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:01.143849 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:01.161081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1280/2549] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:01 2022] PUT /identity/v3/projects/cd117a4989974de6a548f647fecc8af1/users/9ae99c1f581342bbaa42647265728a79/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:01.172399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:01.172751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:01.173036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:01.215654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] MFA Rules not processed for user `9ae99c1f581342bbaa42647265728a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:01.217202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:01.318528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1270/2550] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:01.331992 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:01.334403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:01.362318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:01.411179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a348-ccb6-4c1d-9fb1-07f6958b1fb1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:01.415525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc508a-a26f-498e-ac65-8766ceb37bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:01.416107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc508a-a26f-498e-ac65-8766ceb37bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:01.416387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc508a-a26f-498e-ac65-8766ceb37bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:01.416755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc508a-a26f-498e-ac65-8766ceb37bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:01.427498 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc508a-a26f-498e-ac65-8766ceb37bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:01.429075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc508a-a26f-498e-ac65-8766ceb37bf9 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:01.439982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1281/2551] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:01.863545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:01.866074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:01.891079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:01.949800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0c499-a3d5-4585-bf41-7ac1065e4525 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:01.957524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:01.958520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:01.958923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:01.959248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] PATH_INFO: `/v3/users/762706c874ee41a080beb92d4eb5c81a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:01.960549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762706c874ee41a080beb92d4eb5c81a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:01.962840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:02.025112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762706c874ee41a080beb92d4eb5c81a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.038905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762706c874ee41a080beb92d4eb5c81a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.039785 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762706c874ee41a080beb92d4eb5c81a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.040483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762706c874ee41a080beb92d4eb5c81a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.048762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762706c874ee41a080beb92d4eb5c81a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.064617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1271/2552] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:01 2022] DELETE /identity/v3/users/762706c874ee41a080beb92d4eb5c81a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:02.069211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:02.069519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:02.069791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:02.089219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:02.090494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:02.160771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1282/2553] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:02.171641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:02.173150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:02.243674 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75663f2-b099-498d-aba4-899d1e92a962 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:02.247427 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:02.248187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:02.248473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:02.248742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:02.258679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:02.260121 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:02.271390 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1272/2554] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:02.655371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:02.658141 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:02.697599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6e6f9-1125-48b5-a1ed-55c98b173d50 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:02.703744 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:02.704657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:02.704934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:02.705203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] PATH_INFO: `/v3/projects/9d39c6b54b7647158044a39d6408c3b6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:02.706448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d39c6b54b7647158044a39d6408c3b6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:02.708404 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:02.767628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d39c6b54b7647158044a39d6408c3b6', 'request_id': 'req-48fd2d55-a8a9-4b12-a1b4-24f90063337a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.774618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d39c6b54b7647158044a39d6408c3b6', 'request_id': 'req-48fd2d55-a8a9-4b12-a1b4-24f90063337a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.781942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d39c6b54b7647158044a39d6408c3b6', 'request_id': 'req-48fd2d55-a8a9-4b12-a1b4-24f90063337a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.797370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] The token cache is being invalidate because project 9d39c6b54b7647158044a39d6408c3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:02.797695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.798358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.800020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1283/2555] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:02 2022] DELETE /identity/v3/projects/9d39c6b54b7647158044a39d6408c3b6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:02.804461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:02.818741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8e774-4bbc-4524-9dd0-c3b9df93a751 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:02.878690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:02.907365 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:02.908340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:02.908759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:02.909028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] PATH_INFO: `/v3/users/4069ff2fd47b46228850fd3a25f3a2c6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:02.910377 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4069ff2fd47b46228850fd3a25f3a2c6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:02.912414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:02.980251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4069ff2fd47b46228850fd3a25f3a2c6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.996746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4069ff2fd47b46228850fd3a25f3a2c6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.997662 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4069ff2fd47b46228850fd3a25f3a2c6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:02.998320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4069ff2fd47b46228850fd3a25f3a2c6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.008465 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-32a7771c-010e-453c-8916-570de78301dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4069ff2fd47b46228850fd3a25f3a2c6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.030389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1273/2556] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:02 2022] DELETE /identity/v3/users/4069ff2fd47b46228850fd3a25f3a2c6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:03.439918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:03.441643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:03.461020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd2d55-a8a9-4b12-a1b4-24f90063337a admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:03.512542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:03.533927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:03.534847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:03.535218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:03.535504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] PATH_INFO: `/v3/projects/2fc411e1298c4eee998585345282f050` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:03.536926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc411e1298c4eee998585345282f050)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:03.539020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:03.591334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc411e1298c4eee998585345282f050', 'request_id': 'req-ab30f11e-2542-465d-ba94-d747eb4d009f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.598356 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc411e1298c4eee998585345282f050', 'request_id': 'req-ab30f11e-2542-465d-ba94-d747eb4d009f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.605579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc411e1298c4eee998585345282f050', 'request_id': 'req-ab30f11e-2542-465d-ba94-d747eb4d009f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.622839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] The token cache is being invalidate because project 2fc411e1298c4eee998585345282f050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:03.623126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.623922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ab30f11e-2542-465d-ba94-d747eb4d009f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:03.625590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1284/2557] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:03 2022] DELETE /identity/v3/projects/2fc411e1298c4eee998585345282f050 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:03.632954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:03.633734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:03.634194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:03.655070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:03.656534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:03.719713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1274/2558] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:03.728862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:03.729476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:03.729476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:03.750074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:03.751675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:03.761165 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1285/2559] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:03.765921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:03.775698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a54cb2-7f0b-4ea2-bec9-6512e901fa61 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:03.780555 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:03.781206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:03.781517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:03.781788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:03.782512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:03.782811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:03.784462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:03.803784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1275/2560] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:03.805316 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:03.814785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651070a9-ffa3-4cd4-a97b-0ed9e33da327 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:03.819431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:03.820075 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:03.820346 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:03.820609 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:03.821288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:03.823208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:03.861886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1286/2561] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:03 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:03.864097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:03.881220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547666-273e-4906-99a7-77c649fd91ac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:03.948542 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:03.969478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:03.970388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:03.970812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:03.971088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:03.977492 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:03.980369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.008814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1276/2562] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:03 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:04.014809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.029131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408f15-7d3d-4a2c-89cb-0d7d4cb76799 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.034636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.035282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.035539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.035840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.036604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.038265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.055953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1287/2563] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:04.057516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.075167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b06-c7fc-4f73-acb7-21b47b003b14 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.081003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2637-0c7f-4e0f-886f-ed6fe57e9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.081730 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2637-0c7f-4e0f-886f-ed6fe57e9870 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.085082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2637-0c7f-4e0f-886f-ed6fe57e9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.085082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2637-0c7f-4e0f-886f-ed6fe57e9870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.085082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2637-0c7f-4e0f-886f-ed6fe57e9870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.085082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2637-0c7f-4e0f-886f-ed6fe57e9870 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.098859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1277/2564] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:04.103397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.113789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48683591-eb00-4ab3-8fb3-e061a3f7db96 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.118341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.119225 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.119497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.119761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] PATH_INFO: `/v3/projects/5ecea1a25c354ced90ac79ea450c7f08/users/aa1f75c2f12549c99164f1ecc20a6e4f/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.135059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecea1a25c354ced90ac79ea450c7f08, user_id=aa1f75c2f12549c99164f1ecc20a6e4f, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.137834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.174213 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1288/2565] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:04 2022] PUT /identity/v3/projects/5ecea1a25c354ced90ac79ea450c7f08/users/aa1f75c2f12549c99164f1ecc20a6e4f/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:04.174875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.175212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.175485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.212840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] MFA Rules not processed for user `aa1f75c2f12549c99164f1ecc20a6e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:04.214300 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:04.312890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1278/2566] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:04.317930 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.393112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1da0-cf02-4b01-8f14-392eada9d2f3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.398032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.398751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.398984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.399264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.399959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.401914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.432835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:04.446510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.450016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1289/2567] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:04 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:04.467817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f5db9-2f83-4dfe-aca3-8efd18bd2762 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.532926 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.534952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:04.563675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.564368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.564642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.565297 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.565848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.567933 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.605920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1279/2568] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:04 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:04.608656 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.623386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f00dbc-fbfa-4d3b-90dd-1747e41859ac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.629050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.630046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.630327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.630798 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.631747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.635287 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.638768 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b63e1-702a-494c-9810-62fb26b0eff1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.642779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.643689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.644186 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.644625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.647039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:04.654526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1280/2569] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:04.655783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.669179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b2b9-dd87-4df7-9804-995908a57f36 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.678625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.680211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.680507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.680784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] PATH_INFO: `/v3/projects/9e8a2e767bae404eaeb35aaf3d75b28a/users/d289bd4edf1249fb85eec702c87a6706/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.704751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8a2e767bae404eaeb35aaf3d75b28a, user_id=d289bd4edf1249fb85eec702c87a6706, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.708476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.724301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.725699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.734301 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1281/2570] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:04 2022] PUT /identity/v3/projects/9e8a2e767bae404eaeb35aaf3d75b28a/users/d289bd4edf1249fb85eec702c87a6706/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:04.737185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.739088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1290/2571] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:04.752755 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:04.838759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cccfb-6e12-4070-9833-4196f28dee90 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.845303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9519-852f-4b03-be50-a01d0b6dbdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.846196 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9519-852f-4b03-be50-a01d0b6dbdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.848505 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9519-852f-4b03-be50-a01d0b6dbdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.848905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9519-852f-4b03-be50-a01d0b6dbdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.849890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9519-852f-4b03-be50-a01d0b6dbdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.851665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9519-852f-4b03-be50-a01d0b6dbdd4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.867944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1282/2572] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:04.872679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:04.889259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9ffe8-26af-4b54-9031-7dec5a1982b3 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:04.902851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:04.903919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.904348 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.904671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] PATH_INFO: `/v3/projects/9e8a2e767bae404eaeb35aaf3d75b28a/users/d289bd4edf1249fb85eec702c87a6706/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.908160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8a2e767bae404eaeb35aaf3d75b28a, user_id=d289bd4edf1249fb85eec702c87a6706, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:04.913530 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:04.937223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1291/2573] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:04 2022] PUT /identity/v3/projects/9e8a2e767bae404eaeb35aaf3d75b28a/users/d289bd4edf1249fb85eec702c87a6706/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:04.948810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:04.949511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:04.949511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:04.985405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] MFA Rules not processed for user `d289bd4edf1249fb85eec702c87a6706`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:04.986667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:05.156642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1283/2574] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:05.165037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:05.169169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:05.267534 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746bb4a-ff51-47e0-ba7d-4866134ce904 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:05.272074 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:05.274527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:05.274527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:05.274527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:05.284805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:05.286586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:05.300840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1292/2575] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:05.405781 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:05.425151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e848c-00a0-4342-8f53-ebe8a4a2f1be None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:05.432788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:05.433304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:05.433640 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:05.433996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:05.503560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:05.505182 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:05.515765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1284/2576] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:05.948689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:05.950785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:06.058704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:06.096064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c5b7c-d249-4c40-b0c5-f7bf4e41cc35 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:06.107554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:06.108703 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:06.109048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:06.109420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:06.111511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:06.133976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:06.135903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583f2c6-54ec-4518-b177-7cc54052019d service nova] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:06.150308 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1293/2577] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:10.114292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:10.116119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:10.151941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:10.180001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ac89-0af1-43ad-a6b4-818e9693c033 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:10.184009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:10.184711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:10.185096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:10.185350 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:10.187203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:10.257756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:10.259167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:10.269683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1285/2578] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:10.584519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:10.585054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:10.585152 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:10.604502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:10.605757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:10.663548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1294/2579] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 20 09:21:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:10.676175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:10.677695 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:10.750169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf03a9-5340-43d5-9db7-10694dbb32d2 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:10.757013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:10.757724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:10.758008 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:10.758270 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:10.767444 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:10.768984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:10.778171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1286/2580] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:21:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:21:10.952032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:10.954106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:10.981692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c9cc2-03b5-43e2-a626-030bd109b0c3 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:10.992378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:10.995769 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:10.996981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:10.997567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:10.998049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] PATH_INFO: `/v3/users/9ae99c1f581342bbaa42647265728a79` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:10.999510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae99c1f581342bbaa42647265728a79)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:11.001544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:11.005945 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed118-de66-4d1d-9395-0b9afa90ce1e service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:11.010937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:11.012076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:11.012421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:11.012751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] PATH_INFO: `/v3/users/aa1f75c2f12549c99164f1ecc20a6e4f` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:11.014510 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1f75c2f12549c99164f1ecc20a6e4f)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:11.016599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:11.069274 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae99c1f581342bbaa42647265728a79'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.087049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae99c1f581342bbaa42647265728a79'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.087254 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1f75c2f12549c99164f1ecc20a6e4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.088468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae99c1f581342bbaa42647265728a79'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.089750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae99c1f581342bbaa42647265728a79'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.099276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-bb1c75f7-04c4-4255-96ad-9370a7b1a4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae99c1f581342bbaa42647265728a79'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.102478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:11.104900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1f75c2f12549c99164f1ecc20a6e4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.105800 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1f75c2f12549c99164f1ecc20a6e4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.106541 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1f75c2f12549c99164f1ecc20a6e4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.117069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1295/2581] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:10 2022] DELETE /identity/v3/users/9ae99c1f581342bbaa42647265728a79 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:11.119422 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-956bb6b8-63c2-4fff-9a92-42f130525433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1f75c2f12549c99164f1ecc20a6e4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:11.122758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:11.123089 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:11.123895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:11.137759 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1287/2582] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:10 2022] DELETE /identity/v3/users/aa1f75c2f12549c99164f1ecc20a6e4f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:11.139979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:11.140328 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:11.140668 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:11.155954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:11.157494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:11.172631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:11.175817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:11.217566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:11.260467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1296/2583] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:11.289654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:11.290024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:11.290767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1288/2584] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:11.299644 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:11.309684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:11.374916 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa4928-fe99-49aa-bf34-a7e493abb393 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:11.380816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:11.381874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:11.382049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:11.382321 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:11.393806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:11.395291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:11.398114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce356f-f141-4439-8093-92710f273f5c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:11.404128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:11.405474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:11.405960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:11.406477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:11.409103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1297/2585] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:11.425148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:11.426749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:11.440120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1289/2586] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:12.249571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:12.251582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:12.265284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac906f-a249-42e0-8a39-cf8170c8ccaa service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:12.270046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:12.271150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.271794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.272292 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] PATH_INFO: `/v3/projects/5ecea1a25c354ced90ac79ea450c7f08` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.273730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecea1a25c354ced90ac79ea450c7f08)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:12.275850 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:12.335542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecea1a25c354ced90ac79ea450c7f08', 'request_id': 'req-5c4119d1-221e-440e-8712-5777b418ebd6'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.341529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecea1a25c354ced90ac79ea450c7f08', 'request_id': 'req-5c4119d1-221e-440e-8712-5777b418ebd6'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.348104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecea1a25c354ced90ac79ea450c7f08', 'request_id': 'req-5c4119d1-221e-440e-8712-5777b418ebd6'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.364948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] The token cache is being invalidate because project 5ecea1a25c354ced90ac79ea450c7f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:12.365258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.366107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.368890 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1298/2587] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:12 2022] DELETE /identity/v3/projects/5ecea1a25c354ced90ac79ea450c7f08 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:12.373361 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:12.385087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9375664-cb5f-435e-b6e1-cee7a401da84 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:12.474529 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:12.476046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:12.490058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:12.491249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.491963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.492440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] PATH_INFO: `/v3/users/d289bd4edf1249fb85eec702c87a6706` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.494210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d289bd4edf1249fb85eec702c87a6706)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:12.496570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:12.498580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4119d1-221e-440e-8712-5777b418ebd6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:12.514718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:12.515661 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.516741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.517449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] PATH_INFO: `/v3/projects/cd117a4989974de6a548f647fecc8af1` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.519607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd117a4989974de6a548f647fecc8af1)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:12.526255 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:12.548845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:12.600621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd289bd4edf1249fb85eec702c87a6706'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.627143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd289bd4edf1249fb85eec702c87a6706'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.628693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd289bd4edf1249fb85eec702c87a6706'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.629804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd289bd4edf1249fb85eec702c87a6706'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.637480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd117a4989974de6a548f647fecc8af1', 'request_id': 'req-3f463069-208a-498f-8404-96c0a638195e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.643539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-abce4e5b-98d2-4afa-b439-25797a5fea8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd289bd4edf1249fb85eec702c87a6706'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.650803 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd117a4989974de6a548f647fecc8af1', 'request_id': 'req-3f463069-208a-498f-8404-96c0a638195e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.669146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1290/2588] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:12 2022] DELETE /identity/v3/users/d289bd4edf1249fb85eec702c87a6706 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:12.669342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd117a4989974de6a548f647fecc8af1', 'request_id': 'req-3f463069-208a-498f-8404-96c0a638195e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.672824 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:12.692289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] The token cache is being invalidate because project cd117a4989974de6a548f647fecc8af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:12.692579 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.693458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-3f463069-208a-498f-8404-96c0a638195e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:12.695648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1299/2589] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:12 2022] DELETE /identity/v3/projects/cd117a4989974de6a548f647fecc8af1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:12.700432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.701343 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.701734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.726212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:12.728045 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:12.826452 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1291/2590] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:12.834942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.835223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.835494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.864428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:12.865689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:12.874467 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1300/2591] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:12.878757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:12.890940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978f01-58e3-4bdf-a9d9-eeafce8c22b4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:12.897528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:12.898213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.898494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.898824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.899900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:12.900920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:12.903388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:12.928558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1292/2592] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:12.930105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:12.950779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306e129-0ed1-4774-8b06-b8ff466ce315 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:12.960345 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:12.961126 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:12.961815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:12.962155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:12.962925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:12.965546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.012575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.014790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.021955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1301/2593] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:12 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:13.032445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.152053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d1d9-007b-4287-855c-a2c6066c335a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.172587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c0e2-2bc8-4ce1-a42f-7cad6bb7cdcf admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.178624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.179586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.179927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.180288 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.181047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.183108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.206636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:13.210935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1302/2594] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:13 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:13.211859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.215545 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.230767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1151bc-36bf-4e31-bbbc-ca8023cd1810 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.239200 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.240738 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.241293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.241569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] PATH_INFO: `/v3/users/6d5b17bf80b64b06a1c2e409730a8e78` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.242842 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5b17bf80b64b06a1c2e409730a8e78)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.244787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.262340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.267772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.267772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.268045 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.272062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.286348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.288040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.299893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1293/2595] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:13.300761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.310653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5b17bf80b64b06a1c2e409730a8e78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.319363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7ec2-2647-42b8-9ce1-e880a5900a55 service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.327101 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.328032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.329326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.329614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.329742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5b17bf80b64b06a1c2e409730a8e78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.330349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5b17bf80b64b06a1c2e409730a8e78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.330464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.330968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5b17bf80b64b06a1c2e409730a8e78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.332244 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.351941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1294/2596] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:13.351941 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.352197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5b17bf80b64b06a1c2e409730a8e78'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.354795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.369173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1303/2597] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:13 2022] DELETE /identity/v3/users/6d5b17bf80b64b06a1c2e409730a8e78 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:13.372642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93cc78-adff-4120-a399-dde8cdf0aec6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.372783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.375132 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.449645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=11,keystone:SELECT=84,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:13.496698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.502456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.503409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.503876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] PATH_INFO: `/v3/projects/9e8a2e767bae404eaeb35aaf3d75b28a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.505988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22083-d243-4ee2-8e7e-156becce2dcc admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.506589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8a2e767bae404eaeb35aaf3d75b28a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.510936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.512199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.513354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.513707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.514449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.515012 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.517327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.530819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1304/2598] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:13.536905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.553819 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1e478-387f-45d7-b440-bc235d2acb47 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.571907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8a2e767bae404eaeb35aaf3d75b28a', 'request_id': 'req-6c270dc1-1371-496e-b61a-72ce8e41352b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.579605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8a2e767bae404eaeb35aaf3d75b28a', 'request_id': 'req-6c270dc1-1371-496e-b61a-72ce8e41352b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.593535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8a2e767bae404eaeb35aaf3d75b28a', 'request_id': 'req-6c270dc1-1371-496e-b61a-72ce8e41352b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.610483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] The token cache is being invalidate because project 9e8a2e767bae404eaeb35aaf3d75b28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:13.611484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.612675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c270dc1-1371-496e-b61a-72ce8e41352b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.614720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1295/2599] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:13 2022] DELETE /identity/v3/projects/9e8a2e767bae404eaeb35aaf3d75b28a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:13.619643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.619988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.620332 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.640895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ecf2-5d7f-41a6-94f9-74ffe343d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.641967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ecf2-5d7f-41a6-94f9-74ffe343d4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.642271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ecf2-5d7f-41a6-94f9-74ffe343d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.642586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ecf2-5d7f-41a6-94f9-74ffe343d4c8 admin admin] PATH_INFO: `/v3/projects/e461b6939fbb467d84e1b3de379f69ba/users/bb81da37554e406bb2f1e1b2cfb42503/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.651432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:13.654079 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.661417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ecf2-5d7f-41a6-94f9-74ffe343d4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e461b6939fbb467d84e1b3de379f69ba, user_id=bb81da37554e406bb2f1e1b2cfb42503, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.664373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ecf2-5d7f-41a6-94f9-74ffe343d4c8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.668607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1296/2600] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:13.668952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.670876 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.681839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1305/2601] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:13 2022] PUT /identity/v3/projects/e461b6939fbb467d84e1b3de379f69ba/users/bb81da37554e406bb2f1e1b2cfb42503/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:13.683469 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ae57-046b-4d7a-b515-067c63caf59d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.683845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ae57-046b-4d7a-b515-067c63caf59d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.684372 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ae57-046b-4d7a-b515-067c63caf59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.694931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171e92c-508d-401e-8778-1d9cee502fe7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.709011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-86a9ae57-046b-4d7a-b515-067c63caf59d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:13.710484 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-86a9ae57-046b-4d7a-b515-067c63caf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.751851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:13.792678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.793751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.794176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.794636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1306/2602] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:13.795226 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] PATH_INFO: `/v3/projects/fbcbffc34fd04d20ae906fcdb591d376` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.796701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9b14-aab5-4f13-bd3a-ecc2b986e2ed None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.796906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbcbffc34fd04d20ae906fcdb591d376)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.797008 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9b14-aab5-4f13-bd3a-ecc2b986e2ed None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.798475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9b14-aab5-4f13-bd3a-ecc2b986e2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.799218 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:13.830084 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4fde9b14-aab5-4f13-bd3a-ecc2b986e2ed None None] MFA Rules not processed for user `bb81da37554e406bb2f1e1b2cfb42503`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:13.831305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4fde9b14-aab5-4f13-bd3a-ecc2b986e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.860111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbcbffc34fd04d20ae906fcdb591d376', 'request_id': 'req-01d5fb85-e6ae-4d85-a011-b1d54478d660'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.866829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbcbffc34fd04d20ae906fcdb591d376', 'request_id': 'req-01d5fb85-e6ae-4d85-a011-b1d54478d660'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.872785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:13.873569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbcbffc34fd04d20ae906fcdb591d376', 'request_id': 'req-01d5fb85-e6ae-4d85-a011-b1d54478d660'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.892771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] The token cache is being invalidate because project fbcbffc34fd04d20ae906fcdb591d376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:13.892961 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.893639 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:13.895208 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1297/2603] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:13 2022] DELETE /identity/v3/projects/fbcbffc34fd04d20ae906fcdb591d376 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:13.895965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:13.897310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.917527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1307/2604] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:13.918994 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.919334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.919570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.941217 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:13.943262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:13.980569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5fb85-e6ae-4d85-a011-b1d54478d660 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:13.987676 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:13.989122 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:13.989657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:13.989922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:13.990879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:13.991264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:13.993065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.011146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1298/2605] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:14.011146 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.011450 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:14.029957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1308/2606] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:14.037135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.062385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a2eef-808e-4ec4-887f-2e981cabcebd None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.076232 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e972-2af4-47a5-8cc9-52eff898c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.076914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e972-2af4-47a5-8cc9-52eff898c84a admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.077179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e972-2af4-47a5-8cc9-52eff898c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.078129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e972-2af4-47a5-8cc9-52eff898c84a admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.078129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092e972-2af4-47a5-8cc9-52eff898c84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.080047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092e972-2af4-47a5-8cc9-52eff898c84a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.103747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:14.131805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1309/2607] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:14.132883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.133167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.133459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.135906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f2af2-550c-4de4-ac3c-17a95563eb8b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.176104 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:14.177481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:14.250969 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e99c32d943148cd8625c3ebd6c11887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.251647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.251946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.252187 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.285812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1310/2608] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:14.286756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.306727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b316fde-bad7-4665-a22a-86ae17e2e052 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.321389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.322734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.323013 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.323284 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.324296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.326958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.338829 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.340973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.352054 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1299/2609] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:14.353139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.359340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1311/2610] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/users => generated 290 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:14.360775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.364206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb473c-b6c4-4a34-83fc-e6dc79b7553c service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.368804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.369513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.369789 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.370368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.371103 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:14.371405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.373310 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.386644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65031-501d-4477-83ec-f4185bd46a57 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.388221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1300/2611] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:14.393174 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.405155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.405155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.405155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.405704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.406220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.406792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab74f8-345f-46bf-a93b-216cd00f5260 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.407601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.411719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.412841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.412968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.413216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.413936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.422181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.432861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1312/2612] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:14.442804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.469610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c032-6ad1-476a-a54a-c63a9e178bf7 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.476900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.477705 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.477986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.478257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.479051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.480835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.491746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1301/2613] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:14.496223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.501154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1313/2614] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:14.512339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.529485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f4be-fac9-4293-95de-0f8ac273418f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.544879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:14.632299 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.634887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.634887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.634887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] PATH_INFO: `/v3/projects/6e05a0b3be254282990ba70dd8856585/users/15b02050a2c340ae8ee06d4a3b50c00f/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.654246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5fe7c-44b7-4f74-8f5a-d50729aa5af6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.667119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa68f7-8d5b-4ce6-b508-3ef1279c01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.667947 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa68f7-8d5b-4ce6-b508-3ef1279c01ea admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.668223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa68f7-8d5b-4ce6-b508-3ef1279c01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.668495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa68f7-8d5b-4ce6-b508-3ef1279c01ea admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.669979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa68f7-8d5b-4ce6-b508-3ef1279c01ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.672757 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa68f7-8d5b-4ce6-b508-3ef1279c01ea admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.674841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e05a0b3be254282990ba70dd8856585, user_id=15b02050a2c340ae8ee06d4a3b50c00f, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.677481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.680847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:14.704675 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1314/2615] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:14 2022] PUT /identity/v3/projects/6e05a0b3be254282990ba70dd8856585/users/15b02050a2c340ae8ee06d4a3b50c00f/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:14.718023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.722084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1302/2616] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:14.722084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.722084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.722084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.724591 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:14.764460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] MFA Rules not processed for user `15b02050a2c340ae8ee06d4a3b50c00f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:14.765974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:14.801287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30e2f-7021-4416-8532-5f05aba6d5d6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.808115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.809003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.809320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.809719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] PATH_INFO: `/v3/users/bb81da37554e406bb2f1e1b2cfb42503` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.814535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb81da37554e406bb2f1e1b2cfb42503)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.817751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.851984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1303/2617] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:14.852988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.870754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6339c1-86d3-448e-aca8-5b1549e77846 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.876059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.876752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.877053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.877393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.878229 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.879850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.891989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1304/2618] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:14.893092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.896366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb81da37554e406bb2f1e1b2cfb42503'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:14.905264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a30b2-2adc-4da1-9854-6752cf75e248 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:14.910420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f0c3d-3b8d-4d8f-a2dc-43d309f7014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:14.911409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f0c3d-3b8d-4d8f-a2dc-43d309f7014f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.911700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f0c3d-3b8d-4d8f-a2dc-43d309f7014f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.911975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f0c3d-3b8d-4d8f-a2dc-43d309f7014f admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.912423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb81da37554e406bb2f1e1b2cfb42503'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:14.912665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f0c3d-3b8d-4d8f-a2dc-43d309f7014f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:14.913140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb81da37554e406bb2f1e1b2cfb42503'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:14.913784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb81da37554e406bb2f1e1b2cfb42503'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:14.914645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f0c3d-3b8d-4d8f-a2dc-43d309f7014f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:14.921908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb81da37554e406bb2f1e1b2cfb42503'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:14.938399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1315/2619] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:14 2022] DELETE /identity/v3/users/bb81da37554e406bb2f1e1b2cfb42503 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:14.939250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:14.940598 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:14.952851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1305/2620] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:14.955034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:14.955313 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:14.955585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:14.964350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:14.975317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:14.976844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.021032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0feb0-21de-489b-be27-807302090c01 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.049711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1306/2621] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:15.049711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.049711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.061511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34bea-64dd-4955-a855-be488ba299ef None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.067242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.068168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.068765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.068765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.069531 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.071447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.096237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1307/2622] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:15 2022] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:15.096448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.097051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.097364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.097644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.098358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.099943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.100058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.101899 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.114543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1316/2623] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:15.115443 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.125567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4178d-48eb-4da2-9a57-27fdcdffdb04 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.130730 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.131341 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.131613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.131877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.132689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.134309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.136385 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:15.149563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1317/2624] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:15.151384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.165793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2ffeb-14c5-4c73-997c-7fd4883d3ac1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.172184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bbda7-4027-4c40-8147-d9bd583644e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.172682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acb87-b52d-4ca5-b88a-bab0a10b5440 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.173021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbda7-4027-4c40-8147-d9bd583644e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.173330 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbda7-4027-4c40-8147-d9bd583644e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.173607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbda7-4027-4c40-8147-d9bd583644e2 admin admin] PATH_INFO: `/v3/projects/4773f6784f7448ecb7e6dd04e4e03c04/users/ca83a443a4234d92928ff1d04f4d4447/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.178575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.179378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.179709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.180088 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.191581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.192428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bbda7-4027-4c40-8147-d9bd583644e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4773f6784f7448ecb7e6dd04e4e03c04, user_id=ca83a443a4234d92928ff1d04f4d4447, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.193199 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.195272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bbda7-4027-4c40-8147-d9bd583644e2 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.205069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1308/2625] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:15.206474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.221738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcde77-1e5d-4f2f-9c47-64c605bd79a0 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.223216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1318/2626] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:15 2022] PUT /identity/v3/projects/4773f6784f7448ecb7e6dd04e4e03c04/users/ca83a443a4234d92928ff1d04f4d4447/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:15.233756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.234061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.234318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.273882 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] MFA Rules not processed for user `ca83a443a4234d92928ff1d04f4d4447`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:15.275373 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.334535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.335661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.336000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.336461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] PATH_INFO: `/v3/projects/7775bff070304ad0955455f64f86ac29/users/a3818a83f62243bda82d299fb658a611/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.362537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7775bff070304ad0955455f64f86ac29, user_id=a3818a83f62243bda82d299fb658a611, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.363202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1319/2627] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:15.369437 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.371758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.374355 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.396693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:15.420516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1309/2628] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:15 2022] PUT /identity/v3/projects/7775bff070304ad0955455f64f86ac29/users/a3818a83f62243bda82d299fb658a611/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:15.430003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.493060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b754b37-3df5-4326-bea0-65a65e090236 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.557881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb781b3-1181-450e-bae2-49879fb14991 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.563136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.563998 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.564326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.564414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.565135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.566946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.576996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.578146 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.578431 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.578847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.581666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1310/2629] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:15.585887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.599490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221613ac-88a7-4ede-9b77-fe14ad6cc95b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.606707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595407da-20aa-4825-a207-282a51757b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.607845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595407da-20aa-4825-a207-282a51757b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.609462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595407da-20aa-4825-a207-282a51757b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.609462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595407da-20aa-4825-a207-282a51757b31 admin admin] PATH_INFO: `/v3/projects/7775bff070304ad0955455f64f86ac29/users/a3818a83f62243bda82d299fb658a611/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.612878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595407da-20aa-4825-a207-282a51757b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7775bff070304ad0955455f64f86ac29, user_id=a3818a83f62243bda82d299fb658a611, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.618908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595407da-20aa-4825-a207-282a51757b31 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.639004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1311/2630] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:15 2022] PUT /identity/v3/projects/7775bff070304ad0955455f64f86ac29/users/a3818a83f62243bda82d299fb658a611/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:15.656486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844af0e-4629-483b-a871-4e357d92305d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.657311 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844af0e-4629-483b-a871-4e357d92305d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.657554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844af0e-4629-483b-a871-4e357d92305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.705085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f844af0e-4629-483b-a871-4e357d92305d None None] MFA Rules not processed for user `a3818a83f62243bda82d299fb658a611`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:15.707071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f844af0e-4629-483b-a871-4e357d92305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.714477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.717287 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.727919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1320/2631] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:15.728796 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.730161 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.746371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:15.748551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee7562-b0a9-4493-8432-c539071e6549 service glance] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.837490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1312/2632] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:15.842230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844af0e-4629-483b-a871-4e357d92305d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:15.843990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f844af0e-4629-483b-a871-4e357d92305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:15.845867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:15.846748 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.847025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.847329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] PATH_INFO: `/v3/projects/e461b6939fbb467d84e1b3de379f69ba` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:15.848607 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e461b6939fbb467d84e1b3de379f69ba)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:15.854787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:15.899885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:15.925371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e461b6939fbb467d84e1b3de379f69ba', 'request_id': 'req-8cbca959-2a68-4ad4-b1df-0787bc204a87'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:15.933438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e461b6939fbb467d84e1b3de379f69ba', 'request_id': 'req-8cbca959-2a68-4ad4-b1df-0787bc204a87'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:15.940169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844af0e-4629-483b-a871-4e357d92305d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:15.946177 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e461b6939fbb467d84e1b3de379f69ba', 'request_id': 'req-8cbca959-2a68-4ad4-b1df-0787bc204a87'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:15.968085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] The token cache is being invalidate because project e461b6939fbb467d84e1b3de379f69ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:15.968551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:15.969494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8cbca959-2a68-4ad4-b1df-0787bc204a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:15.976533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1321/2633] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:15 2022] DELETE /identity/v3/projects/e461b6939fbb467d84e1b3de379f69ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:15.982273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f39639-d6e9-4f04-a945-0fe0cff626fb None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:15.982645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f39639-d6e9-4f04-a945-0fe0cff626fb None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:15.983118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f39639-d6e9-4f04-a945-0fe0cff626fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.008800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-21f39639-d6e9-4f04-a945-0fe0cff626fb None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:16.010841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-21f39639-d6e9-4f04-a945-0fe0cff626fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:16.024936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.026115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.026803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.027611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.030583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:16.116546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1322/2634] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:16.132033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.132327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.132580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.166527 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.169940 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.178779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:16.180727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:16.184882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1313/2635] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:16.194919 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1323/2636] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:16.199250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.226164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34493649-3b47-4a88-946c-a8257e0f61f8 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.252494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.253308 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.253627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.253960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.254650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:16.254968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.256805 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.285136 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1314/2637] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:16.290735 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.310505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ff03-242b-4d29-b931-2cc3b3902c3c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.322987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.332721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.348026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.348026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.348026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.379938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.459700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1324/2638] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:16 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:16.464119 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.482585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a15928-5303-4226-82cf-618638ff8a04 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.508642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:16.593111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.593845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.595533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.595533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.595533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.597259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.626248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1315/2639] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:16 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:16.627347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.639083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693771-ee56-4e10-9229-e91d1a9ff86c admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.644120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.644787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.645058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.645350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.646078 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.647732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.662113 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1325/2640] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:16.666334 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.685055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47539c-a2aa-4edd-abb3-73aa569e672b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.702209 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde7d48-65a7-4c86-8407-10c35756ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.703362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde7d48-65a7-4c86-8407-10c35756ac0b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.703736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde7d48-65a7-4c86-8407-10c35756ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.704381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde7d48-65a7-4c86-8407-10c35756ac0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.705258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde7d48-65a7-4c86-8407-10c35756ac0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.707376 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde7d48-65a7-4c86-8407-10c35756ac0b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.723499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1316/2641] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:16.727832 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.743845 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca91bc-871c-408f-85ea-165bd57628b7 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.749289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.750366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.750650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.750924 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] PATH_INFO: `/v3/projects/e117fce370a5401fb71e2b6e8f041e7a/users/82e4fb9542544d26968b9077f29e9a44/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.768535 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e117fce370a5401fb71e2b6e8f041e7a, user_id=82e4fb9542544d26968b9077f29e9a44, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.771306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:16.786966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1326/2642] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:16 2022] PUT /identity/v3/projects/e117fce370a5401fb71e2b6e8f041e7a/users/82e4fb9542544d26968b9077f29e9a44/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:16.800166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.800581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.800930 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.826544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.829649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:16.851891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] MFA Rules not processed for user `82e4fb9542544d26968b9077f29e9a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:16.853814 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:16.957965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:16.982009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc2cbf-7009-4933-842c-4bf916723bc7 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:16.984248 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1317/2643] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:16.987624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:16.988756 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:16.989915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:16.990206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:16.990601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] PATH_INFO: `/v3/users/15b02050a2c340ae8ee06d4a3b50c00f` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:16.991911 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b02050a2c340ae8ee06d4a3b50c00f)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:16.993868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.008378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc81a21-9f9c-4a5c-add5-ec0549cc8cc8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.015424 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.016179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.016455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.016722 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.017474 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.019524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.057608 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1318/2644] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:16 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:17.062504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.097514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b02050a2c340ae8ee06d4a3b50c00f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:17.120792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b02050a2c340ae8ee06d4a3b50c00f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:17.121901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b02050a2c340ae8ee06d4a3b50c00f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:17.122739 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b02050a2c340ae8ee06d4a3b50c00f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:17.133060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-01a6ae88-90cf-477b-9281-95df63462582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b02050a2c340ae8ee06d4a3b50c00f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:17.158654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1327/2645] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:16 2022] DELETE /identity/v3/users/15b02050a2c340ae8ee06d4a3b50c00f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:17.161150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6933d-a011-4c16-a726-136e0ed444f1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.164619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.166925 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.167294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.168631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:17.206788 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:17.212711 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:17.275480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.276127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.277142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.277142 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.278001 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.281946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.334432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1319/2646] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:17 2022] POST /identity/v3/users => generated 291 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:17.339686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.342661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:17.349564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1328/2647] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:17.363403 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbf9a6-d092-48a0-aa0f-aa3bdf81277a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.366549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.368023 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:17.368458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.369932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.370224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.370498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.371429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.373654 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.396151 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1320/2648] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:17.401065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.416828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d48426-d7ae-481b-a9b5-7f1da71be81a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.423934 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.432038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.432370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.432646 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] PATH_INFO: `/v3/projects/781b4f2d2b9d4171973aad14e0fdb88e/users/716beb684e8747f5bf96ac852a69443d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.471232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781b4f2d2b9d4171973aad14e0fdb88e, user_id=716beb684e8747f5bf96ac852a69443d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.476472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.531375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1321/2649] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:17 2022] PUT /identity/v3/projects/781b4f2d2b9d4171973aad14e0fdb88e/users/716beb684e8747f5bf96ac852a69443d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:17.532459 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de675c8-30fe-4a62-8cb4-b72b600d1ae2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.535321 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.613897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:17.654107 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c446d-a188-46c5-ac5d-9871b73d049d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.655516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c446d-a188-46c5-ac5d-9871b73d049d service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.655862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c446d-a188-46c5-ac5d-9871b73d049d service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.656230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c446d-a188-46c5-ac5d-9871b73d049d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.657734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99d7e6-6395-4021-bdf9-772fa42cfa27 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.664569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.665375 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.665787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.666058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.666786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.668388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.674910 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c446d-a188-46c5-ac5d-9871b73d049d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.677068 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c446d-a188-46c5-ac5d-9871b73d049d service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.683614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1322/2650] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:17.685315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.696931 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1329/2651] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:17.697651 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2d43-7ce3-4081-9767-6bcb95c21e1a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:17.703831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:17.704893 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.705357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.705751 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] PATH_INFO: `/v3/projects/781b4f2d2b9d4171973aad14e0fdb88e/users/716beb684e8747f5bf96ac852a69443d/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.708968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=781b4f2d2b9d4171973aad14e0fdb88e, user_id=716beb684e8747f5bf96ac852a69443d, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:17.711760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:17.734712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1323/2652] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:17 2022] PUT /identity/v3/projects/781b4f2d2b9d4171973aad14e0fdb88e/users/716beb684e8747f5bf96ac852a69443d/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:17.736875 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:17.737151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:17.737710 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:17.795525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] MFA Rules not processed for user `716beb684e8747f5bf96ac852a69443d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:17.797285 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:17.915184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1330/2653] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:17.928138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:17.929909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:17.992696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:18.000212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e461f-8792-47b0-9f6c-83548657d26d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:18.004992 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:18.005943 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:18.006234 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:18.006949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:18.018010 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:18.020028 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:18.031669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1324/2654] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:18.084561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:18.086463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:18.099261 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8bfef-3ad1-4c01-9a49-0ec9c549c63f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:18.102915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:18.103582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:18.103859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:18.104155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:18.106097 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:18.191880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:18.193052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:18.204532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1331/2655] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:18.433486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:18.435602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:18.552845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056adc-9e42-45ff-8f08-e9145eb599fc service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:18.565576 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:18.567098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:18.567503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:18.567780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] PATH_INFO: `/v3/projects/6e05a0b3be254282990ba70dd8856585` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:18.569806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e05a0b3be254282990ba70dd8856585)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:18.571820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:18.708371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e05a0b3be254282990ba70dd8856585', 'request_id': 'req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:18.722500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e05a0b3be254282990ba70dd8856585', 'request_id': 'req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:18.730493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e05a0b3be254282990ba70dd8856585', 'request_id': 'req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:18.751913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] The token cache is being invalidate because project 6e05a0b3be254282990ba70dd8856585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:18.752314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:18.753478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:18.756493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1325/2656] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:18 2022] DELETE /identity/v3/projects/6e05a0b3be254282990ba70dd8856585 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:18.760781 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:18.777098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c71c-0542-4fae-b885-fbaa3bf59a5c service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:18.892690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:18.905852 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:18.907118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:18.907549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:18.907951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] PATH_INFO: `/v3/users/a3818a83f62243bda82d299fb658a611` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:18.909699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3818a83f62243bda82d299fb658a611)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:18.912816 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:18.994303 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3818a83f62243bda82d299fb658a611'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.031527 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3818a83f62243bda82d299fb658a611'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.032306 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3818a83f62243bda82d299fb658a611'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.033732 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3818a83f62243bda82d299fb658a611'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.042654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3818a83f62243bda82d299fb658a611'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.080562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1332/2657] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:18 2022] DELETE /identity/v3/users/a3818a83f62243bda82d299fb658a611 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:19.524648 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:19.531714 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:19.550560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3b2e-d1e4-4f98-8d0a-af8789b7f879 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:19.568691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:19.571519 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:19.646827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:19.647719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:19.647994 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:19.648263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] PATH_INFO: `/v3/projects/7775bff070304ad0955455f64f86ac29` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:19.649746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7775bff070304ad0955455f64f86ac29)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:19.652056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:19.657863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0b5b7-6a73-4b77-9805-58fea48cbb21 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:19.664374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:19.668175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:19.668625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:19.669034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] PATH_INFO: `/v3/users/34a67e50fe91465391ee1afa15ed433a` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:19.670643 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a67e50fe91465391ee1afa15ed433a)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:19.672766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:19.695939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:19.739942 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7775bff070304ad0955455f64f86ac29', 'request_id': 'req-b407b80c-1216-40e9-8421-8d42054544af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.748137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7775bff070304ad0955455f64f86ac29', 'request_id': 'req-b407b80c-1216-40e9-8421-8d42054544af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.758952 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7775bff070304ad0955455f64f86ac29', 'request_id': 'req-b407b80c-1216-40e9-8421-8d42054544af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.760974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a67e50fe91465391ee1afa15ed433a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.779594 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a67e50fe91465391ee1afa15ed433a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.780611 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a67e50fe91465391ee1afa15ed433a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.781588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a67e50fe91465391ee1afa15ed433a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.800265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-861a3504-5191-4793-b109-6a76a19dc8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a67e50fe91465391ee1afa15ed433a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.803690 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:19.807414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] The token cache is being invalidate because project 7775bff070304ad0955455f64f86ac29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:19.807715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.808622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b407b80c-1216-40e9-8421-8d42054544af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:19.810614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1326/2658] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:19 2022] DELETE /identity/v3/projects/7775bff070304ad0955455f64f86ac29 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:19.815618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:19.816037 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:19.816353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:19.822276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1333/2659] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:19 2022] DELETE /identity/v3/users/34a67e50fe91465391ee1afa15ed433a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:19.852793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:19.854336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:19.949726 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1327/2660] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:19.962593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:19.962593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:19.962593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:19.984822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:19.986478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.000889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1334/2661] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:20.004995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.015971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e09e-5370-4a16-a874-85abc11d915f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.020931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.021635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.021919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.022189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.022922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:20.023231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.024840 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.037683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.039546 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1328/2662] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:20.039696 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.070593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3838fe-852d-4865-ae18-ec8b32b5e6c1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.077814 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.078773 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.078960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.079130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] PATH_INFO: `/v3/projects/52f6f80ec8f84d81915c87a77c8ebe14` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.081595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f6f80ec8f84d81915c87a77c8ebe14)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.083575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.103504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.120318 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386986e-eff7-4fa7-aa91-e13be4344cb0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.126764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.127573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.127860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.128134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.128856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.131486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.149972 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f6f80ec8f84d81915c87a77c8ebe14', 'request_id': 'req-a72f5730-d8d8-48cb-997b-651cd46b0c67'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.157350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f6f80ec8f84d81915c87a77c8ebe14', 'request_id': 'req-a72f5730-d8d8-48cb-997b-651cd46b0c67'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.165721 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f6f80ec8f84d81915c87a77c8ebe14', 'request_id': 'req-a72f5730-d8d8-48cb-997b-651cd46b0c67'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.169479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1329/2663] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:20 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:20.170721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.180340 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] The token cache is being invalidate because project 52f6f80ec8f84d81915c87a77c8ebe14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:20.180707 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.181613 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.183565 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1335/2664] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:20 2022] DELETE /identity/v3/projects/52f6f80ec8f84d81915c87a77c8ebe14 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:20.189272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.192143 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.329641 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5730-d8d8-48cb-997b-651cd46b0c67 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.336115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.337266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.337400 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.337647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] PATH_INFO: `/v3/users/51dd9856aa4f41b9ad1012cfa6a9a76d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.339731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a0954-05fa-4131-9d5e-3ab4ccffd781 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.342364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51dd9856aa4f41b9ad1012cfa6a9a76d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.344900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.347118 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.347872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.348153 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.348433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.349190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.351280 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.376316 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1330/2665] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:20 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:20.380971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.386176 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.396573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:20.400720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3f72-ce8e-4b96-a54e-4cfc606a3b53 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.410911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.411724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.412440 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.412976 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.414023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.415856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.416482 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51dd9856aa4f41b9ad1012cfa6a9a76d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.428243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1331/2666] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:20.432982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.434201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51dd9856aa4f41b9ad1012cfa6a9a76d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.436090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51dd9856aa4f41b9ad1012cfa6a9a76d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.436764 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51dd9856aa4f41b9ad1012cfa6a9a76d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.443534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789b4b0-90e6-4a76-8684-734781802403 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.444098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=17,keystone:SELECT=82,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:20.446982 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-66d35b0c-ff0e-4fd3-97cb-f81772216ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51dd9856aa4f41b9ad1012cfa6a9a76d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.448458 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.449126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.449436 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.449709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.450981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.452661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.464421 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1332/2667] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:20.465309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1336/2668] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:20 2022] DELETE /identity/v3/users/51dd9856aa4f41b9ad1012cfa6a9a76d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:20.468655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.470630 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.484778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddb5da-695e-4b66-8047-4dc6baea72b9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.547138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.548157 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.548620 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.548928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] PATH_INFO: `/v3/projects/7f9b2f6121424dc8b8151dc380e973c7/users/5f2b438732b64d4783301fe1e8a89355/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.566815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9b2f6121424dc8b8151dc380e973c7, user_id=5f2b438732b64d4783301fe1e8a89355, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.569518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.584636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1333/2669] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:20 2022] PUT /identity/v3/projects/7f9b2f6121424dc8b8151dc380e973c7/users/5f2b438732b64d4783301fe1e8a89355/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:20.595965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.596251 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.596525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.624610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] MFA Rules not processed for user `5f2b438732b64d4783301fe1e8a89355`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:20.625934 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.659559 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.662271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.698692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1337/2670] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:20.712737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:20.714361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:20.744004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc965b-8c10-4f97-9d63-8bb67ed4e00c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.749009 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.750405 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.750954 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.751543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] PATH_INFO: `/v3/projects/bbe83e5066e543b4831b2ffc79db0d98` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.753694 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe83e5066e543b4831b2ffc79db0d98)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.756665 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.774462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade8da-ac00-43ce-9d98-f09844e4df62 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:20.778318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:20.779016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:20.779286 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:20.779603 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:20.788973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:20.790666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:20.801523 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1338/2671] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:20.810239 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe83e5066e543b4831b2ffc79db0d98', 'request_id': 'req-b6793cb7-95d3-42a8-8945-2bf230df651d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.819482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe83e5066e543b4831b2ffc79db0d98', 'request_id': 'req-b6793cb7-95d3-42a8-8945-2bf230df651d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.827145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe83e5066e543b4831b2ffc79db0d98', 'request_id': 'req-b6793cb7-95d3-42a8-8945-2bf230df651d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.836360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:20.844553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] The token cache is being invalidate because project bbe83e5066e543b4831b2ffc79db0d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:20.844839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.845513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b6793cb7-95d3-42a8-8945-2bf230df651d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:20.847056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1334/2672] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:20 2022] DELETE /identity/v3/projects/bbe83e5066e543b4831b2ffc79db0d98 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:21.880350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:21.882007 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:21.898366 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16bb1c-80e6-4cc8-b75c-d5fa4c38839c service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:21.959733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:21.960640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:21.960915 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:21.961183 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] PATH_INFO: `/v3/users/82e4fb9542544d26968b9077f29e9a44` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:21.962652 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e4fb9542544d26968b9077f29e9a44)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:21.964600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:21.992680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:22.023853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e4fb9542544d26968b9077f29e9a44'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.035887 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e4fb9542544d26968b9077f29e9a44'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.036561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e4fb9542544d26968b9077f29e9a44'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.037595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e4fb9542544d26968b9077f29e9a44'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.047586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e4fb9542544d26968b9077f29e9a44'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.066129 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1339/2673] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:21 2022] DELETE /identity/v3/users/82e4fb9542544d26968b9077f29e9a44 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:22.068126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:22.068642 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:22.068879 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:22.089040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:22.090312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:22.156847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1335/2674] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:22.167119 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:22.169689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:22.244927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3203d-9402-4e51-b69a-86d45105ea86 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:22.248789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:22.249471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:22.249750 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:22.250020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:22.259434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:22.260862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:22.270694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1340/2675] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:22.588026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:22.589937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:22.605212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30cb3e-5f83-4a9d-b62c-c3bbe96b80ab None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:22.612702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:22.613578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:22.613873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:22.614233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] PATH_INFO: `/v3/projects/e117fce370a5401fb71e2b6e8f041e7a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:22.615512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e117fce370a5401fb71e2b6e8f041e7a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:22.617565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:22.670808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e117fce370a5401fb71e2b6e8f041e7a', 'request_id': 'req-cddc5fc3-4433-499e-ae59-e90fe7173539'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.677148 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e117fce370a5401fb71e2b6e8f041e7a', 'request_id': 'req-cddc5fc3-4433-499e-ae59-e90fe7173539'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.685523 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e117fce370a5401fb71e2b6e8f041e7a', 'request_id': 'req-cddc5fc3-4433-499e-ae59-e90fe7173539'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.701537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] The token cache is being invalidate because project e117fce370a5401fb71e2b6e8f041e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:22.701824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.702480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.704231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1336/2676] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:22 2022] DELETE /identity/v3/projects/e117fce370a5401fb71e2b6e8f041e7a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:22.708761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:22.719027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c43b-e943-48f9-bb26-976e07be6727 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:22.787327 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:22.788368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:22.788647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:22.788943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] PATH_INFO: `/v3/users/716beb684e8747f5bf96ac852a69443d` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:22.790350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716beb684e8747f5bf96ac852a69443d)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:22.792541 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:22.847881 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:22.849701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716beb684e8747f5bf96ac852a69443d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.870677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716beb684e8747f5bf96ac852a69443d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.871453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716beb684e8747f5bf96ac852a69443d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.872092 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716beb684e8747f5bf96ac852a69443d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.879772 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8d4f6a4e-9cc5-414e-8048-eb1a2f2f9bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716beb684e8747f5bf96ac852a69443d'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:22.898270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1341/2677] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:22 2022] DELETE /identity/v3/users/716beb684e8747f5bf96ac852a69443d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:23.288055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.289824 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:23.312535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5fc3-4433-499e-ae59-e90fe7173539 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.375058 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.376034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.376272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.376547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] PATH_INFO: `/v3/projects/781b4f2d2b9d4171973aad14e0fdb88e` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.378018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781b4f2d2b9d4171973aad14e0fdb88e)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.380344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.405904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:23.441594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781b4f2d2b9d4171973aad14e0fdb88e', 'request_id': 'req-a1597911-324d-41bc-964f-7df898c827c8'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:23.447583 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781b4f2d2b9d4171973aad14e0fdb88e', 'request_id': 'req-a1597911-324d-41bc-964f-7df898c827c8'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:23.454675 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781b4f2d2b9d4171973aad14e0fdb88e', 'request_id': 'req-a1597911-324d-41bc-964f-7df898c827c8'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:23.469324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] The token cache is being invalidate because project 781b4f2d2b9d4171973aad14e0fdb88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:23.469679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:23.470305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a1597911-324d-41bc-964f-7df898c827c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:23.472205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1337/2678] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:23 2022] DELETE /identity/v3/projects/781b4f2d2b9d4171973aad14e0fdb88e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:23.478805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.479320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.479567 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.500599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:23.501840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:23.574221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1342/2679] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:23.584516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.584830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.585071 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.603839 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:23.605132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:23.615736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1338/2680] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:23.620475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.633901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecb6e-2e63-4ae0-ba23-619b039df946 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.639176 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.639889 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.640196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.640464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.641244 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:23.641559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.643231 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.662958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1343/2681] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:23.664612 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.674682 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730aba1-fe75-4fb8-a6d3-66335b8b5e30 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.679607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.680420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.680696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.680962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.681679 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.683545 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.717274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1339/2682] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:23 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:23.719678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.730695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330576-60cf-4163-8d16-7bac973a55f6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.801193 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.801913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.802192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.802463 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.803195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.805114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.829662 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1344/2683] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:23 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:23.834140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.846338 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8416224-9a0f-4d0b-bff4-aaecd262bb2e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.851772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.852462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.852741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.853012 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.853803 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.855410 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.868476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1340/2684] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:23.877612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.888987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14978e8-ee0b-4153-8f63-55514ef32898 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.894032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae46b5a-efb8-4ab6-a431-df6aa55efc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.894698 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae46b5a-efb8-4ab6-a431-df6aa55efc9d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.895151 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae46b5a-efb8-4ab6-a431-df6aa55efc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.895382 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae46b5a-efb8-4ab6-a431-df6aa55efc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.896120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae46b5a-efb8-4ab6-a431-df6aa55efc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.898248 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae46b5a-efb8-4ab6-a431-df6aa55efc9d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.910307 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1345/2685] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:23.914677 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:23.925657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce2d7f-c47d-4c56-b07c-32c6f8122509 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:23.933047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:23.933047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.933047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.933047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] PATH_INFO: `/v3/projects/8752c8421fd84a8dacc625dc5ba92c2c/users/d54457f7a3fb41c9b82fe784d29e9ec3/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:23.949475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8752c8421fd84a8dacc625dc5ba92c2c, user_id=d54457f7a3fb41c9b82fe784d29e9ec3, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:23.952412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:23.977342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1341/2686] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:23 2022] PUT /identity/v3/projects/8752c8421fd84a8dacc625dc5ba92c2c/users/d54457f7a3fb41c9b82fe784d29e9ec3/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:23.979913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:23.980201 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:23.980480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.011461 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] MFA Rules not processed for user `d54457f7a3fb41c9b82fe784d29e9ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:24.012874 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:24.031179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:24.092757 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1346/2687] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:24.097511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.169276 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d868d-f22e-467e-a2dd-4cf264e503f3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.175240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.175911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.176190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.176456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.177161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.179138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.208167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1342/2688] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:24 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:24.213995 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.226279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccafad9-79da-4885-9720-6cab5f1a4b0c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.288001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.288927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.289209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.289513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.290215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.292219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.318638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1347/2689] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:24 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:24.323342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.339918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74f28-82cb-427f-9f5e-8c391fbdba2a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.346768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.347478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.347754 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.348021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.348914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.350605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.367598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1343/2690] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:24.368956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.381158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8dcf-92b2-4248-8968-60a66d204461 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.386790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.387963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.388249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.388595 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] PATH_INFO: `/v3/projects/415d32ed6ad742a992656e5f655527c9/users/74d9a55216a243d1aecb997be9274389/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.405877 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=415d32ed6ad742a992656e5f655527c9, user_id=74d9a55216a243d1aecb997be9274389, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.408886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.424622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1348/2691] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:24 2022] PUT /identity/v3/projects/415d32ed6ad742a992656e5f655527c9/users/74d9a55216a243d1aecb997be9274389/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:24.428909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.439995 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70597133-dd05-48b5-a507-c3ddec84e3e7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.457083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:24.503696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763d750-b341-4212-8ad8-e67e3cacb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.504396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763d750-b341-4212-8ad8-e67e3cacb9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.504667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763d750-b341-4212-8ad8-e67e3cacb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.505112 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763d750-b341-4212-8ad8-e67e3cacb9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.505962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763d750-b341-4212-8ad8-e67e3cacb9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.507574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763d750-b341-4212-8ad8-e67e3cacb9b7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.519219 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1344/2692] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:24.526298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.543048 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37122069-e156-449c-b731-317d2bb73e5b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.549412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.550302 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.550573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.550839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] PATH_INFO: `/v3/projects/415d32ed6ad742a992656e5f655527c9/users/74d9a55216a243d1aecb997be9274389/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.553189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415d32ed6ad742a992656e5f655527c9, user_id=74d9a55216a243d1aecb997be9274389, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.555883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.567983 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1349/2693] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:24 2022] PUT /identity/v3/projects/415d32ed6ad742a992656e5f655527c9/users/74d9a55216a243d1aecb997be9274389/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:24.581951 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.582215 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.582517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.609864 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] MFA Rules not processed for user `74d9a55216a243d1aecb997be9274389`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:24.611074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:24.687828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1345/2694] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:24.698783 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:24.701116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:24.763885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f5bf-68ec-4148-b4c8-98d49c9ab479 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:24.767943 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f856d0-d30a-4784-ad2e-e1642380c072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:24.768599 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f856d0-d30a-4784-ad2e-e1642380c072 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:24.768872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f856d0-d30a-4784-ad2e-e1642380c072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:24.769140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f856d0-d30a-4784-ad2e-e1642380c072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:24.779281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f856d0-d30a-4784-ad2e-e1642380c072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:24.780706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f856d0-d30a-4784-ad2e-e1642380c072 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:24.790782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1350/2695] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:25.432793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:25.518428 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599383e-ab9e-4186-a58c-d06fa2d791c8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:25.523914 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:25.524909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:25.525320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:25.525609 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] PATH_INFO: `/v3/users/d54457f7a3fb41c9b82fe784d29e9ec3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:25.527205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54457f7a3fb41c9b82fe784d29e9ec3)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:25.529190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:25.596783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:25.599748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54457f7a3fb41c9b82fe784d29e9ec3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:25.616233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54457f7a3fb41c9b82fe784d29e9ec3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:25.617065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54457f7a3fb41c9b82fe784d29e9ec3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:25.617771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54457f7a3fb41c9b82fe784d29e9ec3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:25.625043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54457f7a3fb41c9b82fe784d29e9ec3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:25.639448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1346/2696] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:25 2022] DELETE /identity/v3/users/d54457f7a3fb41c9b82fe784d29e9ec3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:25.644021 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:25.645360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:25.645633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:25.666689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:25.668112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:25.678260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:25.737304 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1351/2697] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:25.748207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:25.749810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:25.822823 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423edb6-78ca-4b79-b795-1f512877ea5d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:25.827653 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:25.829360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:25.829633 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:25.829923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:25.841742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:25.845579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:25.861831 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1347/2698] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:26.219415 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:26.220902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:26.240224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4b9d3-c79a-40e4-b3b4-3f374fcbcf9d None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:26.245612 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:26.246492 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:26.246853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:26.247131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] PATH_INFO: `/v3/projects/8752c8421fd84a8dacc625dc5ba92c2c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:26.248525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8752c8421fd84a8dacc625dc5ba92c2c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:26.250501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:26.317986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8752c8421fd84a8dacc625dc5ba92c2c', 'request_id': 'req-56fbe03a-114f-43cf-abc5-da3f5c86c046'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.324742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8752c8421fd84a8dacc625dc5ba92c2c', 'request_id': 'req-56fbe03a-114f-43cf-abc5-da3f5c86c046'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.334512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:26.338985 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:26.341466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8752c8421fd84a8dacc625dc5ba92c2c', 'request_id': 'req-56fbe03a-114f-43cf-abc5-da3f5c86c046'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.357762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1169445-2ab6-4486-a354-ff47d8f04891 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:26.368511 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] The token cache is being invalidate because project 8752c8421fd84a8dacc625dc5ba92c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:26.368905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.369767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.372020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1352/2699] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:26 2022] DELETE /identity/v3/projects/8752c8421fd84a8dacc625dc5ba92c2c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:26.375706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:26.377145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:26.443145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:26.445083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:26.445585 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:26.450258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] PATH_INFO: `/v3/users/5f2b438732b64d4783301fe1e8a89355` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:26.453569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2b438732b64d4783301fe1e8a89355)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:26.456249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:26.475234 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe03a-114f-43cf-abc5-da3f5c86c046 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:26.491103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:26.493054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:26.493546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:26.494035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] PATH_INFO: `/v3/users/74d9a55216a243d1aecb997be9274389` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:26.497401 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d9a55216a243d1aecb997be9274389)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:26.499991 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:26.520194 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2b438732b64d4783301fe1e8a89355'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.540739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2b438732b64d4783301fe1e8a89355'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.541534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2b438732b64d4783301fe1e8a89355'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.542185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2b438732b64d4783301fe1e8a89355'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.545577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:26.556622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c21c2370-cfe9-42f2-b8c7-da9dfce64c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2b438732b64d4783301fe1e8a89355'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.568863 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:26.587066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1348/2700] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:26 2022] DELETE /identity/v3/users/5f2b438732b64d4783301fe1e8a89355 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:26.588750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:26.589038 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:26.589637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:26.589905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d9a55216a243d1aecb997be9274389'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.611425 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d9a55216a243d1aecb997be9274389'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.612094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d9a55216a243d1aecb997be9274389'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.612782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d9a55216a243d1aecb997be9274389'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.617923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:26.617923 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:26.621218 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d9a55216a243d1aecb997be9274389'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:26.646079 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1353/2701] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:26 2022] DELETE /identity/v3/users/74d9a55216a243d1aecb997be9274389 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:26.712253 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1349/2702] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:26.733650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:26.735111 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:26.842660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171d08-3790-4393-8a73-882ace9eaf89 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:26.847406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:26.848636 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:26.849042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:26.849354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:26.968900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:26.970413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:26.989996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1354/2703] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:27.269455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.271429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.286516 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ff50a-1a79-4760-bff1-528e754d7bdc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.292231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.293304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.293637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.293971 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] PATH_INFO: `/v3/projects/415d32ed6ad742a992656e5f655527c9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.295830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=415d32ed6ad742a992656e5f655527c9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.297780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.354501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.356018 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.372736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415d32ed6ad742a992656e5f655527c9', 'request_id': 'req-f2855554-0cff-4d0a-a71b-66f1f3f927cc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.385489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5a60-a260-474b-9fe6-52218b0cb644 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.388242 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415d32ed6ad742a992656e5f655527c9', 'request_id': 'req-f2855554-0cff-4d0a-a71b-66f1f3f927cc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.405628 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415d32ed6ad742a992656e5f655527c9', 'request_id': 'req-f2855554-0cff-4d0a-a71b-66f1f3f927cc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.428473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] The token cache is being invalidate because project 415d32ed6ad742a992656e5f655527c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:27.428772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.429762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f2855554-0cff-4d0a-a71b-66f1f3f927cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.437274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1350/2704] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:27 2022] DELETE /identity/v3/projects/415d32ed6ad742a992656e5f655527c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:27.441472 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466920b1-27ca-40ec-8528-ea56d589b52a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.441799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466920b1-27ca-40ec-8528-ea56d589b52a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.442150 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466920b1-27ca-40ec-8528-ea56d589b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.466949 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.467850 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-466920b1-27ca-40ec-8528-ea56d589b52a None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:27.468325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.468427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.468793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] PATH_INFO: `/v3/projects/7f9b2f6121424dc8b8151dc380e973c7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.469080 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-466920b1-27ca-40ec-8528-ea56d589b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.470260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9b2f6121424dc8b8151dc380e973c7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.472468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.477783 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1351/2705] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:27.483006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:27.486315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.486774 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.487189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.508092 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:27.509418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.518592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1352/2706] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:27.522808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.533387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762bdb-3818-4d77-918c-c2402adf25bc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.535533 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9b2f6121424dc8b8151dc380e973c7', 'request_id': 'req-530881c0-e0bf-4355-b945-cdad64e2629e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.541453 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9b2f6121424dc8b8151dc380e973c7', 'request_id': 'req-530881c0-e0bf-4355-b945-cdad64e2629e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.550338 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9b2f6121424dc8b8151dc380e973c7', 'request_id': 'req-530881c0-e0bf-4355-b945-cdad64e2629e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.574347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] The token cache is being invalidate because project 7f9b2f6121424dc8b8151dc380e973c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:27.574941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.576090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-530881c0-e0bf-4355-b945-cdad64e2629e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:27.578077 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1355/2707] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:27 2022] DELETE /identity/v3/projects/7f9b2f6121424dc8b8151dc380e973c7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:27.582918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebacd44-321a-474d-90fb-145b5ee06205 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.583483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebacd44-321a-474d-90fb-145b5ee06205 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.583483 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebacd44-321a-474d-90fb-145b5ee06205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.592359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:27.602504 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-4ebacd44-321a-474d-90fb-145b5ee06205 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:27.603807 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-4ebacd44-321a-474d-90fb-145b5ee06205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.604020 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.606056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.606575 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.606887 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.607790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:27.608128 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.609953 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.612546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1356/2708] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:27.620590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.620873 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.621147 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.628046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1353/2709] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:27.632355 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.634281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.648323 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30170f47-6c85-458a-b551-961d4eb2a4a3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.650204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:27.651804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:27.654392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.655053 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.655336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.655611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.656306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.658298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.660294 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1357/2710] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:27.664706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.677039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50748-7004-462c-b58e-a5908b9373e1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.686351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.690023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1354/2711] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:27.690157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.690157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.690157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.690157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:27.690157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.690619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.691331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.703497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1358/2712] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:27.707903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.718215 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16511-b638-4d12-b62a-cb6953f2214e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.763017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfe9e-5168-428b-b4a8-71f82ec03791 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.768848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.769558 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.769989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.770265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.770966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.772922 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.782417 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.783065 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.783370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.783654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.784328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.786300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.793621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1355/2713] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:27.798881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.809905 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd932b-3dcf-4b1b-a4ce-5ad1206f4340 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.814471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.814929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1359/2714] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:27.817498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.817792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.818069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.818853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.819191 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.820535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.831488 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1356/2715] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:27.835560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.848863 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7233ca-f08a-43b5-8aa1-901a0b8ba171 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.881913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:27.888974 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d772ee-5fb7-4b6a-ad18-290414f51f1f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.895500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.896253 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.896526 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.896797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.897514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.899485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.917036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.918167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.918454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.918856 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.919778 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.920279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1360/2716] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:27.921513 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.924335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.932597 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1357/2717] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:27.934277 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4e07-7c80-45fe-aace-94904f6b7f23 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.936572 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.939175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.939840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.940118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.940389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.941135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.942791 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.946804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ae62-151c-4c1a-93ff-9bd65ae7a8d5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.951918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.952782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.953056 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.953353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] PATH_INFO: `/v3/projects/6aa9f9b69f964b65bfda761e7a340e2b/users/1a9afd54eef7453b8ef9a219af9aee9d/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.953559 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1361/2718] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:27.957416 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:27.967871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb348592-21f5-4091-a94a-665df6a0a534 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:27.970431 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa9f9b69f964b65bfda761e7a340e2b, user_id=1a9afd54eef7453b8ef9a219af9aee9d, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.973206 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.973827 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4e520-6896-4a98-ac72-298317f9dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:27.974494 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4e520-6896-4a98-ac72-298317f9dd8d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:27.974775 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4e520-6896-4a98-ac72-298317f9dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:27.975051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4e520-6896-4a98-ac72-298317f9dd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:27.975854 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4e520-6896-4a98-ac72-298317f9dd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:27.977632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4e520-6896-4a98-ac72-298317f9dd8d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:27.987999 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1358/2719] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:27 2022] PUT /identity/v3/projects/6aa9f9b69f964b65bfda761e7a340e2b/users/1a9afd54eef7453b8ef9a219af9aee9d/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:27.996695 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1362/2720] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:27.998349 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:28.000531 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.000979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.001388 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.016748 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:28.029666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] MFA Rules not processed for user `1a9afd54eef7453b8ef9a219af9aee9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:28.030903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:28.063416 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e2e4-265e-4191-97e8-0148513cd4f7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:28.067904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae430-fb3e-4a60-a29a-389ffd67f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:28.068795 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae430-fb3e-4a60-a29a-389ffd67f396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.069069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae430-fb3e-4a60-a29a-389ffd67f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.069371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae430-fb3e-4a60-a29a-389ffd67f396 admin admin] PATH_INFO: `/v3/projects/589f3d561b5f4636a85402495dabf88c/users/77a0cc5a776e4cbd8a69dbdcb46bcd98/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.084451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ae430-fb3e-4a60-a29a-389ffd67f396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589f3d561b5f4636a85402495dabf88c, user_id=77a0cc5a776e4cbd8a69dbdcb46bcd98, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:28.087243 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ae430-fb3e-4a60-a29a-389ffd67f396 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:28.095966 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1363/2721] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:28.103062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1359/2722] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:27 2022] PUT /identity/v3/projects/589f3d561b5f4636a85402495dabf88c/users/77a0cc5a776e4cbd8a69dbdcb46bcd98/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:28.107546 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:28.109325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:28.115290 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.115616 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.115907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.143777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] MFA Rules not processed for user `77a0cc5a776e4cbd8a69dbdcb46bcd98`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:28.144972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:28.171517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e3e0c-34fa-47c5-9b87-74ca8304e4de None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:28.220132 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1360/2723] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:28.230464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b1222-098e-412f-b76b-70e0ae90712b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:28.231276 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b1222-098e-412f-b76b-70e0ae90712b service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.231638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b1222-098e-412f-b76b-70e0ae90712b service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.231912 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b1222-098e-412f-b76b-70e0ae90712b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.247907 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:28.249378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:28.256032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:28.262499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ce254-4938-4d52-b179-3fb58f65d918 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:28.269344 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:28.270613 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.271145 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.271539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.280508 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:28.282007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:28.291494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1361/2724] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:28.300015 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b1222-098e-412f-b76b-70e0ae90712b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:28.301626 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b1222-098e-412f-b76b-70e0ae90712b service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:28.313986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1364/2725] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:28.333592 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:28.398898 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de850-d898-4e88-a2a5-9a1d23e64278 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:28.403650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:28.404526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.404804 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.405073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] PATH_INFO: `/v3/users/1a9afd54eef7453b8ef9a219af9aee9d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.406926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9afd54eef7453b8ef9a219af9aee9d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:28.408845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:28.426304 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:28.461420 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9afd54eef7453b8ef9a219af9aee9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:28.475346 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9afd54eef7453b8ef9a219af9aee9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:28.476205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9afd54eef7453b8ef9a219af9aee9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:28.476895 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9afd54eef7453b8ef9a219af9aee9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:28.484335 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9afd54eef7453b8ef9a219af9aee9d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:28.498928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1362/2726] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:28 2022] DELETE /identity/v3/users/1a9afd54eef7453b8ef9a219af9aee9d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:28.503596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.503880 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.504154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.523326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:28.524623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:28.588379 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1365/2727] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:28.601138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:28.602744 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:28.663359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d961da-ea28-466f-a45a-0c3e7c8e5f41 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:28.667135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fe8ea-3e7f-4ec6-a4d1-02226ccd9316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:28.667792 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fe8ea-3e7f-4ec6-a4d1-02226ccd9316 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:28.668064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fe8ea-3e7f-4ec6-a4d1-02226ccd9316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:28.668306 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fe8ea-3e7f-4ec6-a4d1-02226ccd9316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:28.678085 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fe8ea-3e7f-4ec6-a4d1-02226ccd9316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:28.679621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fe8ea-3e7f-4ec6-a4d1-02226ccd9316 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:28.689578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1363/2728] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:28.997537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:28.999027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:29.014914 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150877dd-ac4b-4964-ada2-eb1837eea536 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.021477 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.022385 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.022689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.023099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] PATH_INFO: `/v3/projects/6aa9f9b69f964b65bfda761e7a340e2b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.024266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa9f9b69f964b65bfda761e7a340e2b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.027039 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.079969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa9f9b69f964b65bfda761e7a340e2b', 'request_id': 'req-ff0365e6-46a4-421c-ab42-fb01662534a1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:29.086438 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa9f9b69f964b65bfda761e7a340e2b', 'request_id': 'req-ff0365e6-46a4-421c-ab42-fb01662534a1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:29.093588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa9f9b69f964b65bfda761e7a340e2b', 'request_id': 'req-ff0365e6-46a4-421c-ab42-fb01662534a1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:29.109076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] The token cache is being invalidate because project 6aa9f9b69f964b65bfda761e7a340e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:29.109407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:29.110050 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ff0365e6-46a4-421c-ab42-fb01662534a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:29.111660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1366/2729] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:28 2022] DELETE /identity/v3/projects/6aa9f9b69f964b65bfda761e7a340e2b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:29.116590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.116878 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.117154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.136716 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:29.137980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:29.205618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1364/2730] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:29.213694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.213978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.214252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.233902 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:29.235195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:29.244083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1367/2731] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:29.249517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.261509 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca137571-512c-45f9-99fa-f83094a7ae0f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.267042 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.267742 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.268013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.268299 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.269097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:29.269451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.271090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.291066 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1365/2732] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:29.296394 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.306361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c68e6-a875-4e8b-9ccb-cb07d7072737 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.312062 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.312737 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.313073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.313384 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.314202 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.316383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.344776 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1368/2733] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:29 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:29.349213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.359494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cefcf-eacb-408e-a32e-36ab4240cb9a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.381734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:29.426314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.427111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.427388 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.427657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.428419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.430372 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.457257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1366/2734] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:29 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:29.462054 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.474476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c695e95-f13f-4e3e-b25a-26dd39b9efee admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.480312 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.480965 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.481444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.481777 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.482512 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.484094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.494448 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1369/2735] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:29.499395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.509894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af5fd5-2c04-4a4e-8c7d-6cf861c9d46c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.516036 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f44f09-7de4-4926-9302-a09fcc1cb7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.516921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f44f09-7de4-4926-9302-a09fcc1cb7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.517074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f44f09-7de4-4926-9302-a09fcc1cb7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.517490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f44f09-7de4-4926-9302-a09fcc1cb7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.518060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f44f09-7de4-4926-9302-a09fcc1cb7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.519577 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f44f09-7de4-4926-9302-a09fcc1cb7ef admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.530473 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1367/2736] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:29.534778 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.545374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21b31b-1647-47ed-a419-4ca89752ef2e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.554290 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.555733 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.556080 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.556411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] PATH_INFO: `/v3/projects/d51a1740c0874a7f9d17e6bfea5f728c/users/604e07d31bd14150a9df219195c86b9e/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.560399 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:29.579087 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51a1740c0874a7f9d17e6bfea5f728c, user_id=604e07d31bd14150a9df219195c86b9e, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.581823 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.596903 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1370/2737] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:29 2022] PUT /identity/v3/projects/d51a1740c0874a7f9d17e6bfea5f728c/users/604e07d31bd14150a9df219195c86b9e/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:29.609167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.609484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.609750 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.637213 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] MFA Rules not processed for user `604e07d31bd14150a9df219195c86b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:29.638600 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:29.706596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1368/2738] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:29.718058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:29.720432 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:29.786073 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47767a3c-610f-49d3-b88a-2b8337349310 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:29.790537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:29.791424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:29.791988 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:29.792581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:29.811986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:29.815289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:29.827258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1371/2739] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:31.358456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:31.359881 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:31.421114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3e6df-6b89-46e7-a629-c3c58bf083d7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:31.425057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:31.425596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:31.425816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:31.426090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:31.427913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:31.474072 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:31.494432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:31.496078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:31.506312 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1369/2740] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:35.016222 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.017760 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:35.033003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a54447-0ee8-490a-811d-5f7b5c2d39eb service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.037403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.038300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.038574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.038840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] PATH_INFO: `/v3/users/00e5f97f0cfd48b59a8e5dc444cee670` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.040053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e5f97f0cfd48b59a8e5dc444cee670)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.042052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.093951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e5f97f0cfd48b59a8e5dc444cee670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.106905 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e5f97f0cfd48b59a8e5dc444cee670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.107714 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e5f97f0cfd48b59a8e5dc444cee670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.108407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e5f97f0cfd48b59a8e5dc444cee670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.117335 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-578796ba-4064-41c9-87b7-1744cd13d153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e5f97f0cfd48b59a8e5dc444cee670'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.135952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1372/2741] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:35 2022] DELETE /identity/v3/users/00e5f97f0cfd48b59a8e5dc444cee670 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:35.327486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.338493 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592500f-5acf-4498-b2d4-a55b57223beb service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.405533 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.407131 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.407412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.407683 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] PATH_INFO: `/v3/projects/b76b12f460ee49ea8b80da53da1ba9a7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.408964 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76b12f460ee49ea8b80da53da1ba9a7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.411188 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.477047 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76b12f460ee49ea8b80da53da1ba9a7', 'request_id': 'req-6867c2a2-e045-493a-a183-5bdc16b8fd22'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.490872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76b12f460ee49ea8b80da53da1ba9a7', 'request_id': 'req-6867c2a2-e045-493a-a183-5bdc16b8fd22'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.498820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76b12f460ee49ea8b80da53da1ba9a7', 'request_id': 'req-6867c2a2-e045-493a-a183-5bdc16b8fd22'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.530074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] The token cache is being invalidate because project b76b12f460ee49ea8b80da53da1ba9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:35.530549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.531289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6867c2a2-e045-493a-a183-5bdc16b8fd22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:35.533087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1370/2742] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:35 2022] DELETE /identity/v3/projects/b76b12f460ee49ea8b80da53da1ba9a7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:35.538563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.538945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.539311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.558542 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:35.560216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:35.622040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:35.637374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1373/2743] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:35.641736 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.642246 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.642525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.663021 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:35.664274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:35.675764 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1371/2744] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:35.680560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.695784 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f5d1-0807-4dea-9117-b3e33c036f2c None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.702650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.703309 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.703585 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.703853 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.704581 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:35.704885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.706552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.719486 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1374/2745] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:35.724228 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.734423 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e11a-358b-44a7-8349-e9cd258c3374 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.739869 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.740536 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.740799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.741065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.741796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.743669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.775184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1372/2746] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:35 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:35.779677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.790654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b0dc-e1ac-4c52-8fa6-67868dd4b918 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.849616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.850281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.850532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.850833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.851517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.853465 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.875815 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1375/2747] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:35 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:35.880106 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.891127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808b49-0915-497f-a4df-fb4bff525f24 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.895938 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.896594 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.896867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.897137 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.897894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.899647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.911057 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1373/2748] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:35.916009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.936003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887842c-a945-470e-9eff-d2c031ff8e42 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.941458 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad0909-804e-45d1-bfa4-57a5626cac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.942115 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad0909-804e-45d1-bfa4-57a5626cac6e admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.942391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad0909-804e-45d1-bfa4-57a5626cac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.942656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad0909-804e-45d1-bfa4-57a5626cac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.943387 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad0909-804e-45d1-bfa4-57a5626cac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.945017 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad0909-804e-45d1-bfa4-57a5626cac6e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:35.956635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1376/2749] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:35.961160 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:35.971993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7da82b-3347-41de-9072-2793cac3dccf admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:35.976632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:35.977552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:35.977886 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:35.978091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] PATH_INFO: `/v3/projects/323373eae9a140cf835eb24ddfaa1b61/users/611ea3a7887f422c883b92b97e4ac70d/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:35.995120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323373eae9a140cf835eb24ddfaa1b61, user_id=611ea3a7887f422c883b92b97e4ac70d, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:35.998017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:36.013218 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1374/2750] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:35 2022] PUT /identity/v3/projects/323373eae9a140cf835eb24ddfaa1b61/users/611ea3a7887f422c883b92b97e4ac70d/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:36.018753 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059bfb9-33df-4850-a736-4b7094cbd92d None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:36.019403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059bfb9-33df-4850-a736-4b7094cbd92d None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:36.019403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059bfb9-33df-4850-a736-4b7094cbd92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:36.038627 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-2059bfb9-33df-4850-a736-4b7094cbd92d None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:36.039952 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2059bfb9-33df-4850-a736-4b7094cbd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:36.103997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1377/2751] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:36.114331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:36.116094 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:36.127817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:36.180974 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cfb28-36fe-449c-91bc-d741b49e4575 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:36.185130 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:36.185833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:36.186134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:36.186400 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:36.197828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:36.199317 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:36.211135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1375/2752] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:36.891653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:36.891888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:36.892099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:36.930076 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] MFA Rules not processed for user `611ea3a7887f422c883b92b97e4ac70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:36.932564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:37.008942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:37.023109 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1378/2753] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:37.028721 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:37.043843 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445639ad-bda4-4f7a-bddf-9d78b53126c1 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:37.050393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:37.051282 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:37.051882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:37.052197 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:37.052981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:37.054975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:37.085152 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1376/2754] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:37 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:37.089480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:37.101935 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34100-3d4f-47cd-9f03-04e38784e39a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:37.163785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:37.164572 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:37.164883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:37.165409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:37.165969 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:37.168120 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:37.188812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1379/2755] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:37 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:37.193029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:37.205389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27161-5979-428a-aabc-ba69fbdbd37e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:37.210482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:37.211286 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:37.211666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:37.212041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:37.212867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:37.214627 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:37.227082 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1377/2756] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:37.232405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:37.245398 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aef35b-0d18-496b-bf8a-396b90d74c35 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:37.250804 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:37.251734 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:37.252003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:37.252275 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] PATH_INFO: `/v3/projects/ec80ef557b4f4f7a9ff2ad8e1c63b1d7/users/ce02cf6997534dba9174938722b3ba0a/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:37.268528 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec80ef557b4f4f7a9ff2ad8e1c63b1d7, user_id=ce02cf6997534dba9174938722b3ba0a, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:37.271236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:37.285460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1380/2757] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:37 2022] PUT /identity/v3/projects/ec80ef557b4f4f7a9ff2ad8e1c63b1d7/users/ce02cf6997534dba9174938722b3ba0a/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:37.290113 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:37.301396 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786ffc-5416-49ca-a3c2-2af0d4709886 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:37.362567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb45bdd-806c-4a07-b189-cf03c2eea517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:37.363250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb45bdd-806c-4a07-b189-cf03c2eea517 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:37.363539 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb45bdd-806c-4a07-b189-cf03c2eea517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:37.363891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb45bdd-806c-4a07-b189-cf03c2eea517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:37.364650 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb45bdd-806c-4a07-b189-cf03c2eea517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:37.366281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb45bdd-806c-4a07-b189-cf03c2eea517 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:37.377550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1378/2758] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:37.381958 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:37.395313 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438749ca-5e51-41d5-ae58-8a336ed0725e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:37.400580 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:37.401634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:37.401976 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:37.402262 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] PATH_INFO: `/v3/projects/ec80ef557b4f4f7a9ff2ad8e1c63b1d7/users/ce02cf6997534dba9174938722b3ba0a/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:37.404799 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec80ef557b4f4f7a9ff2ad8e1c63b1d7, user_id=ce02cf6997534dba9174938722b3ba0a, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:37.407514 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:37.419305 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1381/2759] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:37 2022] PUT /identity/v3/projects/ec80ef557b4f4f7a9ff2ad8e1c63b1d7/users/ce02cf6997534dba9174938722b3ba0a/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:38.135193 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee37c-3e15-46fb-b227-128da18c7256 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:38.135749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee37c-3e15-46fb-b227-128da18c7256 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:38.135911 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee37c-3e15-46fb-b227-128da18c7256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:38.177603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fd9ee37c-3e15-46fb-b227-128da18c7256 None None] MFA Rules not processed for user `ce02cf6997534dba9174938722b3ba0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:38.177603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fd9ee37c-3e15-46fb-b227-128da18c7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:38.272371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:38.281500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1379/2760] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:39.017653 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.020700 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.098257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ff2a-e731-4379-bbca-76d4d72685e1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:39.103180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:39.103986 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.104258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.104522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] PATH_INFO: `/v3/users/ca83a443a4234d92928ff1d04f4d4447` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.105793 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca83a443a4234d92928ff1d04f4d4447)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:39.107713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:39.158536 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca83a443a4234d92928ff1d04f4d4447'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.159818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:39.174537 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca83a443a4234d92928ff1d04f4d4447'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.175259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca83a443a4234d92928ff1d04f4d4447'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.175865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca83a443a4234d92928ff1d04f4d4447'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.183325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca83a443a4234d92928ff1d04f4d4447'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.198273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1382/2761] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:39 2022] DELETE /identity/v3/users/ca83a443a4234d92928ff1d04f4d4447 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:39.203154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.203673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.203673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.221787 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:39.223011 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.283303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1380/2762] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:39.297359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.297359 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.364724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ecef7-b566-4b46-af97-daa77bba16a6 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:39.368666 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:39.369478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.369841 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.370034 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.380391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:39.381933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:39.396371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1383/2763] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:39.398165 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.399761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.414240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6800a0-9bc6-427c-a853-c7609304b809 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:39.419345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:39.420581 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.421040 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.421569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] PATH_INFO: `/v3/users/611ea3a7887f422c883b92b97e4ac70d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.423178 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611ea3a7887f422c883b92b97e4ac70d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:39.425108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:39.474560 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611ea3a7887f422c883b92b97e4ac70d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.486996 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611ea3a7887f422c883b92b97e4ac70d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.487723 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611ea3a7887f422c883b92b97e4ac70d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.488386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611ea3a7887f422c883b92b97e4ac70d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.495655 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611ea3a7887f422c883b92b97e4ac70d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.523512 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1381/2764] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:39 2022] DELETE /identity/v3/users/611ea3a7887f422c883b92b97e4ac70d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:39.696782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.698259 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.718839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea90880-2c8d-470b-be93-dd1a79f6521c service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:39.753780 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.755419 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.796256 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:39.797130 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.797554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.797779 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] PATH_INFO: `/v3/projects/4773f6784f7448ecb7e6dd04e4e03c04` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.798977 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4773f6784f7448ecb7e6dd04e4e03c04)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:39.800927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:39.832003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db94da-b387-4162-b7cb-1754b849b475 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:39.837485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:39.838498 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.838875 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.839459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] PATH_INFO: `/v3/projects/323373eae9a140cf835eb24ddfaa1b61` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.840838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=323373eae9a140cf835eb24ddfaa1b61)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:39.843041 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:39.857376 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4773f6784f7448ecb7e6dd04e4e03c04', 'request_id': 'req-75285b45-1e43-463a-831f-9c44b06625b0'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.863534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:39.865745 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4773f6784f7448ecb7e6dd04e4e03c04', 'request_id': 'req-75285b45-1e43-463a-831f-9c44b06625b0'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.874638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4773f6784f7448ecb7e6dd04e4e03c04', 'request_id': 'req-75285b45-1e43-463a-831f-9c44b06625b0'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.883257 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:39.889014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] The token cache is being invalidate because project 4773f6784f7448ecb7e6dd04e4e03c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:39.889582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.890822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-75285b45-1e43-463a-831f-9c44b06625b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.895883 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1384/2765] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:39 2022] DELETE /identity/v3/projects/4773f6784f7448ecb7e6dd04e4e03c04 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:39.897429 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:39.898209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:39.898851 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:39.916769 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323373eae9a140cf835eb24ddfaa1b61', 'request_id': 'req-e1883f43-285b-445a-9ea6-149737f888dc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.920962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:39.922475 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.926485 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323373eae9a140cf835eb24ddfaa1b61', 'request_id': 'req-e1883f43-285b-445a-9ea6-149737f888dc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.939070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323373eae9a140cf835eb24ddfaa1b61', 'request_id': 'req-e1883f43-285b-445a-9ea6-149737f888dc'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.958702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] The token cache is being invalidate because project 323373eae9a140cf835eb24ddfaa1b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:39.959203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.959819 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:39.964919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1382/2766] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:39 2022] DELETE /identity/v3/projects/323373eae9a140cf835eb24ddfaa1b61 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:39.965944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.967354 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:39.987866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1385/2767] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:39.990127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:39.991413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.003220 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81186c-0f58-4519-8911-8772f9329691 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.007939 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.008810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.009091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.009503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] PATH_INFO: `/v3/users/77a0cc5a776e4cbd8a69dbdcb46bcd98` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.010713 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a0cc5a776e4cbd8a69dbdcb46bcd98)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.013195 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.040183 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883f43-285b-445a-9ea6-149737f888dc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.047496 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.048927 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.049525 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.049913 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] PATH_INFO: `/v3/users/ce02cf6997534dba9174938722b3ba0a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.051673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce02cf6997534dba9174938722b3ba0a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.054062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.076706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a0cc5a776e4cbd8a69dbdcb46bcd98'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.090326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a0cc5a776e4cbd8a69dbdcb46bcd98'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.091414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a0cc5a776e4cbd8a69dbdcb46bcd98'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.092270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a0cc5a776e4cbd8a69dbdcb46bcd98'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.100922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-967dc59c-4f36-44f9-b566-9185bc6bcc69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a0cc5a776e4cbd8a69dbdcb46bcd98'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.112958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce02cf6997534dba9174938722b3ba0a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.114551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1386/2768] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:39 2022] DELETE /identity/v3/users/77a0cc5a776e4cbd8a69dbdcb46bcd98 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:40.115955 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.116178 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.116449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.127645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce02cf6997534dba9174938722b3ba0a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.128409 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce02cf6997534dba9174938722b3ba0a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.129413 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce02cf6997534dba9174938722b3ba0a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.135582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:40.136500 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-60f9ea4b-299d-411d-83d4-1a6252a26050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce02cf6997534dba9174938722b3ba0a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.136787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.150622 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1383/2769] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:39 2022] DELETE /identity/v3/users/ce02cf6997534dba9174938722b3ba0a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:40.151919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.152203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.152477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.172634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:40.174604 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.195712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:40.207782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1387/2770] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:40.211806 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.221826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ef483-05d1-4a04-8124-801ab2b129a2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.229997 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:40.253273 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1384/2771] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:40.263611 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.265406 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.300724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.300999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.301249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.301785 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.302548 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:40.303515 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.305755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.320782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1388/2772] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:40.326861 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.338085 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3432a-c547-4fba-a2a0-cf6a8849386b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.343377 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.344103 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.344444 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.344808 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.345600 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.347663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.348351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afdaa8-0f19-412e-8a70-902dd1eac993 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.352866 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.353566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.353845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.354117 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.364614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.366212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.376988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1385/2773] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:21:40.377892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.379204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.383566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1389/2774] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:40.389108 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.399320 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61085ac-2b03-4abb-b77f-6155c04c7026 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.464471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5683bd-410f-48cc-ba71-8dc6a15a7606 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.470180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.471368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.471368 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.471625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.471749 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.472169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.472430 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.472713 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.472984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] PATH_INFO: `/v3/projects/ec80ef557b4f4f7a9ff2ad8e1c63b1d7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.474204 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec80ef557b4f4f7a9ff2ad8e1c63b1d7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.474328 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.476216 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.497032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1390/2775] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:40.501434 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.513185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1322-acc6-40ae-98b0-5f9f49320ed4 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.517928 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.518597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.518869 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.519131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.519865 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.521488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.534378 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1391/2776] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:40.537162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec80ef557b4f4f7a9ff2ad8e1c63b1d7', 'request_id': 'req-d136cbf4-be0a-426e-a9fa-8626af0c2d29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.538650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.546143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec80ef557b4f4f7a9ff2ad8e1c63b1d7', 'request_id': 'req-d136cbf4-be0a-426e-a9fa-8626af0c2d29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.555589 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28815b16-c2c3-4211-a21b-eab7df523d55 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.556919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec80ef557b4f4f7a9ff2ad8e1c63b1d7', 'request_id': 'req-d136cbf4-be0a-426e-a9fa-8626af0c2d29'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.561983 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:40.576684 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] The token cache is being invalidate because project ec80ef557b4f4f7a9ff2ad8e1c63b1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:40.576909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.577980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d136cbf4-be0a-426e-a9fa-8626af0c2d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.579686 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1386/2777] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:40 2022] DELETE /identity/v3/projects/ec80ef557b4f4f7a9ff2ad8e1c63b1d7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:40.585073 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.585455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.585808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.606455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:40.607786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.626127 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.626762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.627051 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.627300 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.628053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.629740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.632118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:40.642810 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1392/2778] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:40.647169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.649933 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.667886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c230-9f69-42c1-8a35-43e1f3c74769 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.672918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd359c-d154-4e2f-b86f-50e5fa0716e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.676464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd359c-d154-4e2f-b86f-50e5fa0716e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.676464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd359c-d154-4e2f-b86f-50e5fa0716e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.676464 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd359c-d154-4e2f-b86f-50e5fa0716e6 admin admin] PATH_INFO: `/v3/projects/83466c2efbd147c0b49a0f47024418a4/users/54a3285266374d66ad871a9d933a05e7/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.695631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd359c-d154-4e2f-b86f-50e5fa0716e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83466c2efbd147c0b49a0f47024418a4, user_id=54a3285266374d66ad871a9d933a05e7, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.696189 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1387/2779] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:40.696993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.702329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.703822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd359c-d154-4e2f-b86f-50e5fa0716e6 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.717637 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4bcad-7e9c-4f8e-b9d5-3eb9a7141abf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:40.719897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1393/2780] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:40 2022] PUT /identity/v3/projects/83466c2efbd147c0b49a0f47024418a4/users/54a3285266374d66ad871a9d933a05e7/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:40.727451 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec31d8-c201-4a70-a7f4-dc3c419d21f0 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.728825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec31d8-c201-4a70-a7f4-dc3c419d21f0 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.729317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec31d8-c201-4a70-a7f4-dc3c419d21f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.749809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a8ec31d8-c201-4a70-a7f4-dc3c419d21f0 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:40.751058 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a8ec31d8-c201-4a70-a7f4-dc3c419d21f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.794109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:40.795115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.795395 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.795664 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] PATH_INFO: `/v3/projects/589f3d561b5f4636a85402495dabf88c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.796890 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589f3d561b5f4636a85402495dabf88c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:40.798970 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:40.826488 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1394/2781] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:40.827899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:40.828214 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:40.828466 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:40.855124 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589f3d561b5f4636a85402495dabf88c', 'request_id': 'req-7dda726b-2024-4fa7-9a66-c4c2b0005a16'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.861856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] MFA Rules not processed for user `54a3285266374d66ad871a9d933a05e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:40.862077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589f3d561b5f4636a85402495dabf88c', 'request_id': 'req-7dda726b-2024-4fa7-9a66-c4c2b0005a16'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.863716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.869980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589f3d561b5f4636a85402495dabf88c', 'request_id': 'req-7dda726b-2024-4fa7-9a66-c4c2b0005a16'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.888263 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] The token cache is being invalidate because project 589f3d561b5f4636a85402495dabf88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:40.888549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.889201 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:40.890921 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1388/2782] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:40 2022] DELETE /identity/v3/projects/589f3d561b5f4636a85402495dabf88c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:40.891702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.893014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.946543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:40.965047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1395/2783] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:40.978844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:40.980485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:40.995552 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda726b-2024-4fa7-9a66-c4c2b0005a16 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.001018 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.001984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.002399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.002672 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.003786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:41.003931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.005788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.024532 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1389/2784] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:41.029138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.041466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7518ed-f307-4965-8781-8904cdcd3561 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.047902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.047902 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.048342 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.048685 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.049587 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.051481 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.052049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb800-a488-4dc6-8add-7c983e288750 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.055844 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.056601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.056987 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.057396 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.067339 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.068979 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.081091 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1396/2785] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:41.086078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1390/2786] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:41 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:41.094998 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.109489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29c92-0c6f-49de-9e3a-2a5743552e39 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.114098 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:41.190457 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.191517 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.191896 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.192296 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.193105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.195163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.218618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1397/2787] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:41 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:41.222918 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.234025 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29156da-5a82-44e0-acbd-2ed06f5c0453 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.238859 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.239554 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.239830 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.240097 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.240828 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.242515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.253429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1391/2788] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:41.257800 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.268460 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4534c-a01e-4120-a9b7-bf02e0d03bc8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.273169 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13772684-e594-4ba6-88e6-d34b1807af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.273868 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772684-e594-4ba6-88e6-d34b1807af99 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.274145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772684-e594-4ba6-88e6-d34b1807af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.274423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772684-e594-4ba6-88e6-d34b1807af99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.275136 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13772684-e594-4ba6-88e6-d34b1807af99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.276770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13772684-e594-4ba6-88e6-d34b1807af99 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.287352 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1398/2789] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:41.292445 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.307808 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33e624-9ad4-42b3-a748-380d33fb451a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.315926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.317049 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.317578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.317578 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] PATH_INFO: `/v3/projects/9632c4c8811d408bba24b13ae4b51816/users/78ee662a164b465ba1aa12ca38ecc076/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.334844 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9632c4c8811d408bba24b13ae4b51816, user_id=78ee662a164b465ba1aa12ca38ecc076, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.337734 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.351383 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1392/2790] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:41 2022] PUT /identity/v3/projects/9632c4c8811d408bba24b13ae4b51816/users/78ee662a164b465ba1aa12ca38ecc076/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:41.362047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.362333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.362649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.391485 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] MFA Rules not processed for user `78ee662a164b465ba1aa12ca38ecc076`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:41.393389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:41.464002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1399/2791] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:41.468779 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.541589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c93e-d87f-4996-9b14-dcb0580f2982 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.547900 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.548564 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.548849 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.549120 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.549845 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.551773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.580848 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1393/2792] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:41 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:41.585038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.596114 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99e08-fd05-4014-bdc9-fd6934c0d696 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.655682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.656349 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.656625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.656895 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.657642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.659587 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.680797 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1400/2793] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:41 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:41.685051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.696059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f888838-dc6a-4c43-be87-d15e90d416e9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.702494 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.703154 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.703426 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.703693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.704480 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.706272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.717603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1394/2794] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:41.722406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.732317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:41.736922 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9556c8-5a8c-4ea6-a360-541de869fe17 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.742836 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.743771 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.744052 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.744325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] PATH_INFO: `/v3/projects/6cae1251d0794f3dba4a5c0c79c9eb99/users/0b69bb4170ff4d07b824ac91ab10c2bc/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.761602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cae1251d0794f3dba4a5c0c79c9eb99, user_id=0b69bb4170ff4d07b824ac91ab10c2bc, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.764727 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.779209 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1401/2795] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:41 2022] PUT /identity/v3/projects/6cae1251d0794f3dba4a5c0c79c9eb99/users/0b69bb4170ff4d07b824ac91ab10c2bc/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:41.783956 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.794631 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435affa-3d26-4fd7-9fb7-de0e4504273d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.832993 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:41.859034 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373a338-3bda-4b54-b3e5-d87b4d5179aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.859733 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373a338-3bda-4b54-b3e5-d87b4d5179aa admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.860017 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373a338-3bda-4b54-b3e5-d87b4d5179aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.860292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373a338-3bda-4b54-b3e5-d87b4d5179aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.861030 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373a338-3bda-4b54-b3e5-d87b4d5179aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.862710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373a338-3bda-4b54-b3e5-d87b4d5179aa admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.873771 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1395/2796] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:41.878543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:41.890064 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667801-f162-4661-a703-e263278982c4 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:41.895574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:41.896476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.896751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.897022 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] PATH_INFO: `/v3/projects/6cae1251d0794f3dba4a5c0c79c9eb99/users/0b69bb4170ff4d07b824ac91ab10c2bc/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.899332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cae1251d0794f3dba4a5c0c79c9eb99, user_id=0b69bb4170ff4d07b824ac91ab10c2bc, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:41.901989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:41.916551 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1402/2797] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:41 2022] PUT /identity/v3/projects/6cae1251d0794f3dba4a5c0c79c9eb99/users/0b69bb4170ff4d07b824ac91ab10c2bc/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:41.927102 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05e1e-810f-4b91-92be-77e0a49e78c7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.927565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05e1e-810f-4b91-92be-77e0a49e78c7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.927711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05e1e-810f-4b91-92be-77e0a49e78c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.957014 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-91d05e1e-810f-4b91-92be-77e0a49e78c7 None None] MFA Rules not processed for user `0b69bb4170ff4d07b824ac91ab10c2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:41.958457 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-91d05e1e-810f-4b91-92be-77e0a49e78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:42.038127 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1396/2798] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:42.050189 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:42.113320 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a36d-611d-407f-8a5f-977ee02089b9 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:42.117298 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:42.117961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:42.118240 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:42.118510 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:42.128742 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:42.130230 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:42.140006 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1403/2799] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:42.481268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a8006-64cc-4edb-a0bf-61c7a7668329 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:42.481799 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a8006-64cc-4edb-a0bf-61c7a7668329 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:42.482078 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a8006-64cc-4edb-a0bf-61c7a7668329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:42.500186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-066a8006-64cc-4edb-a0bf-61c7a7668329 None None] MFA Rules not processed for user `54a3285266374d66ad871a9d933a05e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:42.501381 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-066a8006-64cc-4edb-a0bf-61c7a7668329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:42.567102 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:42.573368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1397/2800] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:42.639946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79956fa-da63-4809-b9d7-22d55cfbdbb7 service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:42.644699 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:42.645640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:42.645953 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:42.646238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] PATH_INFO: `/v3/users/78ee662a164b465ba1aa12ca38ecc076` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:42.647420 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ee662a164b465ba1aa12ca38ecc076)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:42.649421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:42.704722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ee662a164b465ba1aa12ca38ecc076'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:42.720272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ee662a164b465ba1aa12ca38ecc076'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:42.721740 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ee662a164b465ba1aa12ca38ecc076'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:42.722353 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ee662a164b465ba1aa12ca38ecc076'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:42.730027 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:42.732347 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ee662a164b465ba1aa12ca38ecc076'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:42.753271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1404/2801] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:42 2022] DELETE /identity/v3/users/78ee662a164b465ba1aa12ca38ecc076 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:42.756657 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:42.756975 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:42.757293 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:42.780719 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:42.781326 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:42.853761 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1398/2802] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:42.864182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:42.865716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:42.933449 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3459a-5700-4fb4-a306-47404787b531 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:42.937706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:42.938358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:42.938631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:42.939019 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:42.949563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:42.951332 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:42.963016 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1405/2803] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:43.300731 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:43.302549 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:43.330567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:43.336031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e713-f343-4b4a-bb3c-62266ae75074 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:43.341590 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:43.342557 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:43.342838 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:43.343107 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] PATH_INFO: `/v3/projects/9632c4c8811d408bba24b13ae4b51816` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:43.344305 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9632c4c8811d408bba24b13ae4b51816)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:43.346257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:43.412138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9632c4c8811d408bba24b13ae4b51816', 'request_id': 'req-2771d8ad-d420-42a2-8e96-1fecfd962545'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.417747 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9632c4c8811d408bba24b13ae4b51816', 'request_id': 'req-2771d8ad-d420-42a2-8e96-1fecfd962545'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.427894 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9632c4c8811d408bba24b13ae4b51816', 'request_id': 'req-2771d8ad-d420-42a2-8e96-1fecfd962545'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.441693 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] The token cache is being invalidate because project 9632c4c8811d408bba24b13ae4b51816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:43.441984 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.442760 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.444624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1399/2804] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:43 2022] DELETE /identity/v3/projects/9632c4c8811d408bba24b13ae4b51816 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:43.448642 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:43.460112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f604e3-36f9-482c-b75a-2e940c464fde service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:43.524094 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:43.524452 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:43.524741 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:43.525131 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] PATH_INFO: `/v3/users/0b69bb4170ff4d07b824ac91ab10c2bc` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:43.526555 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b69bb4170ff4d07b824ac91ab10c2bc)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:43.528562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:43.584762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b69bb4170ff4d07b824ac91ab10c2bc'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.598522 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b69bb4170ff4d07b824ac91ab10c2bc'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.599325 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b69bb4170ff4d07b824ac91ab10c2bc'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.599957 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b69bb4170ff4d07b824ac91ab10c2bc'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.608197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-5d8898a9-33f6-4d07-b7a7-8eb345b78673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b69bb4170ff4d07b824ac91ab10c2bc'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:43.623024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1406/2805] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:43 2022] DELETE /identity/v3/users/0b69bb4170ff4d07b824ac91ab10c2bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:43.932641 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:43.934259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:43.950794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771d8ad-d420-42a2-8e96-1fecfd962545 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.012588 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.013534 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.013815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.014089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] PATH_INFO: `/v3/projects/6cae1251d0794f3dba4a5c0c79c9eb99` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.015386 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cae1251d0794f3dba4a5c0c79c9eb99)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.017345 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.079820 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cae1251d0794f3dba4a5c0c79c9eb99', 'request_id': 'req-752c1907-abb3-429e-8960-035681ca632f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:44.086910 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cae1251d0794f3dba4a5c0c79c9eb99', 'request_id': 'req-752c1907-abb3-429e-8960-035681ca632f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:44.093833 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cae1251d0794f3dba4a5c0c79c9eb99', 'request_id': 'req-752c1907-abb3-429e-8960-035681ca632f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:44.109515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] The token cache is being invalidate because project 6cae1251d0794f3dba4a5c0c79c9eb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:44.109816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:44.110471 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-752c1907-abb3-429e-8960-035681ca632f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:44.112484 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1400/2806] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:43 2022] DELETE /identity/v3/projects/6cae1251d0794f3dba4a5c0c79c9eb99 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:44.117629 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.117929 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.118210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.138959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:44.140326 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:44.151014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:44.262671 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1407/2807] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:44.271511 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.271816 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.272303 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.298169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:44.299669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:44.309972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1401/2808] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:44.314351 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.325893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251c75c-ab11-4db4-963a-fd1c7fda4ee8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.331192 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.332243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.332571 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.332856 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.333632 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:44.333954 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.336067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.358105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1408/2809] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:44.359441 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.369936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723741b-d960-4cdd-937f-256b4d357667 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.375643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.376333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.376591 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.376872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.377618 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.379569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.398264 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:44.428690 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1402/2810] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:44.433562 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.446723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb6e4-cf1c-4066-9456-9610a6a551d8 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.515360 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.516059 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.516219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.516516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.517221 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.519211 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.543216 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1409/2811] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:44.548466 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.562602 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4091dc-918f-4a81-9cc3-7f6963cb6263 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.568233 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.568932 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.569214 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.569519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.573393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.575701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.592548 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1403/2812] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:44.594014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.610224 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e41c-a145-434c-bea8-a37d4f141323 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.615081 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65467773-ded0-4e16-8bae-b5a958c14248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.615747 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467773-ded0-4e16-8bae-b5a958c14248 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.616024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467773-ded0-4e16-8bae-b5a958c14248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.616295 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467773-ded0-4e16-8bae-b5a958c14248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.617025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467773-ded0-4e16-8bae-b5a958c14248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.618679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467773-ded0-4e16-8bae-b5a958c14248 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.630423 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1410/2813] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:44.635673 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.646767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8d953-60d1-4d48-a593-37db9c9eb9ab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.652207 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.653140 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.653451 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.653786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] PATH_INFO: `/v3/projects/21559f727a844d05bba6a9add963f997/users/701cd52e39b44d6a95d4df1d60648b03/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.670090 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21559f727a844d05bba6a9add963f997, user_id=701cd52e39b44d6a95d4df1d60648b03, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.672777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.693958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1404/2814] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:44 2022] PUT /identity/v3/projects/21559f727a844d05bba6a9add963f997/users/701cd52e39b44d6a95d4df1d60648b03/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:44.704839 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.705167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.705495 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.739364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] MFA Rules not processed for user `701cd52e39b44d6a95d4df1d60648b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:44.740615 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:44.812634 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1411/2815] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:44.817647 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.894860 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d532fe-b15a-4dfe-8550-4b5cfe977f4f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.900678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:44.901524 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:44.901815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:44.902091 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:44.902929 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:44.905967 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:44.935815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1405/2816] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:44.940406 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:44.953794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bb7e7-2467-463f-b709-d0870677e7f6 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:44.958437 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:45.019573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:45.020272 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.020557 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.020826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.021575 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:45.023502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:45.048422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1412/2817] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:44 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:45.052586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:45.064271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562d928-a76b-4e62-a291-c5b217730e85 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:45.069621 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:45.070454 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.070739 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.071016 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.071743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:45.073378 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:45.086351 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1406/2818] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:45.090981 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:45.101334 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35391e-3d9b-4b83-9df5-f3bd1a6d23ea admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:45.106030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:45.106937 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.107525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.107525 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] PATH_INFO: `/v3/projects/7e3e4ed49aac41f68a452f470a338647/users/cb380e44939b4c898049f0012c204496/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.123090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3e4ed49aac41f68a452f470a338647, user_id=cb380e44939b4c898049f0012c204496, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:45.125973 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:45.143658 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1413/2819] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:45 2022] PUT /identity/v3/projects/7e3e4ed49aac41f68a452f470a338647/users/cb380e44939b4c898049f0012c204496/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:45.148464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:45.160238 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcf006-a214-49fb-9f02-5c7b0a47a585 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:45.234857 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f50d92-9bda-4d15-a5a9-7bb302dfe6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:45.235603 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f50d92-9bda-4d15-a5a9-7bb302dfe6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.235885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f50d92-9bda-4d15-a5a9-7bb302dfe6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.236167 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f50d92-9bda-4d15-a5a9-7bb302dfe6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.237023 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f50d92-9bda-4d15-a5a9-7bb302dfe6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:45.238706 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f50d92-9bda-4d15-a5a9-7bb302dfe6fd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:45.250892 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1407/2820] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:45.256001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:45.268962 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a416-309b-4988-b087-6e61a94f889e admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:45.274556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:45.276118 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.276414 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.276683 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] PATH_INFO: `/v3/projects/7e3e4ed49aac41f68a452f470a338647/users/cb380e44939b4c898049f0012c204496/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.279281 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3e4ed49aac41f68a452f470a338647, user_id=cb380e44939b4c898049f0012c204496, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:45.282283 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:45.300835 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1414/2821] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:45 2022] PUT /identity/v3/projects/7e3e4ed49aac41f68a452f470a338647/users/cb380e44939b4c898049f0012c204496/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:45.312710 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.313006 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.313348 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.349336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] MFA Rules not processed for user `cb380e44939b4c898049f0012c204496`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:45.350660 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:45.366192 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:45.440470 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1408/2822] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:45.456563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:45.456563 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:45.534311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4445e-290a-4de9-9f65-35989d57f700 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:45.539631 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d3c7b-275c-441f-af0c-67e6dd141f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:45.540369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d3c7b-275c-441f-af0c-67e6dd141f56 service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:45.540712 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d3c7b-275c-441f-af0c-67e6dd141f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:45.541053 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d3c7b-275c-441f-af0c-67e6dd141f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:45.551680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d3c7b-275c-441f-af0c-67e6dd141f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:45.553061 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d3c7b-275c-441f-af0c-67e6dd141f56 service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:45.565070 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1415/2823] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:47.213331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:47.334044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e88697-9895-4b6d-9b5e-7248fe00f928 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:47.338720 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be198626-e526-4913-b360-045280f126ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:47.339670 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be198626-e526-4913-b360-045280f126ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:47.339946 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be198626-e526-4913-b360-045280f126ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:47.340220 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be198626-e526-4913-b360-045280f126ec admin admin] PATH_INFO: `/v3/users/701cd52e39b44d6a95d4df1d60648b03` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:47.341796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be198626-e526-4913-b360-045280f126ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=701cd52e39b44d6a95d4df1d60648b03)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:47.343809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be198626-e526-4913-b360-045280f126ec admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:47.396429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be198626-e526-4913-b360-045280f126ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701cd52e39b44d6a95d4df1d60648b03'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:47.409741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be198626-e526-4913-b360-045280f126ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701cd52e39b44d6a95d4df1d60648b03'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:47.410547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be198626-e526-4913-b360-045280f126ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701cd52e39b44d6a95d4df1d60648b03'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:47.411255 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be198626-e526-4913-b360-045280f126ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701cd52e39b44d6a95d4df1d60648b03'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:47.415926 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:47.419084 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be198626-e526-4913-b360-045280f126ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701cd52e39b44d6a95d4df1d60648b03'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:47.438584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1409/2824] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:47 2022] DELETE /identity/v3/users/701cd52e39b44d6a95d4df1d60648b03 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:47.443187 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:47.443684 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:47.443794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:47.493792 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:47.495185 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:47.527940 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:47.562693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1416/2825] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:47.569766 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be198626-e526-4913-b360-045280f126ec admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:47.574272 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-be198626-e526-4913-b360-045280f126ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:47.676772 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be198626-e526-4913-b360-045280f126ec admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:47.680786 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:47.681491 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:47.681793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:47.682067 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:47.691979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:47.693455 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:47.703735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1410/2826] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:47.994818 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:47.996726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:48.034686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a17ddd-aa81-4ba8-9164-25dc89f456c8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:48.039358 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:48.041456 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:48.041967 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:48.042867 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] PATH_INFO: `/v3/projects/21559f727a844d05bba6a9add963f997` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:48.044361 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21559f727a844d05bba6a9add963f997)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:48.046588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:48.117026 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21559f727a844d05bba6a9add963f997', 'request_id': 'req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.123397 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21559f727a844d05bba6a9add963f997', 'request_id': 'req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.129901 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21559f727a844d05bba6a9add963f997', 'request_id': 'req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.144566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] The token cache is being invalidate because project 21559f727a844d05bba6a9add963f997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:48.144836 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.145577 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.147350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1417/2827] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:47 2022] DELETE /identity/v3/projects/21559f727a844d05bba6a9add963f997 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:48.151249 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:48.165519 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3c89-ebf6-44fd-9284-f38ae3b93073 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:48.230741 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:48.231632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:48.231909 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:48.232184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] PATH_INFO: `/v3/users/cb380e44939b4c898049f0012c204496` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:48.233495 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb380e44939b4c898049f0012c204496)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:48.235732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:48.289111 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb380e44939b4c898049f0012c204496'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.302599 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb380e44939b4c898049f0012c204496'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.303357 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb380e44939b4c898049f0012c204496'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.304005 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb380e44939b4c898049f0012c204496'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.312191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f163ae48-0501-4436-83ff-ceef199325a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb380e44939b4c898049f0012c204496'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.314775 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:48.329737 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1411/2828] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:48 2022] DELETE /identity/v3/users/cb380e44939b4c898049f0012c204496 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:48.635892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:48.637654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:48.658656 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ac49f-5708-4da6-92b5-233deb5fc9f1 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:48.725624 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:48.726490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:48.726766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:48.727036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] PATH_INFO: `/v3/projects/7e3e4ed49aac41f68a452f470a338647` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:48.728249 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3e4ed49aac41f68a452f470a338647)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:48.730188 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:48.779160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3e4ed49aac41f68a452f470a338647', 'request_id': 'req-6411eea2-43d6-404f-8d46-88627207958f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.784968 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3e4ed49aac41f68a452f470a338647', 'request_id': 'req-6411eea2-43d6-404f-8d46-88627207958f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.787071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:48.792135 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3e4ed49aac41f68a452f470a338647', 'request_id': 'req-6411eea2-43d6-404f-8d46-88627207958f'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.807314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] The token cache is being invalidate because project 7e3e4ed49aac41f68a452f470a338647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:48.807596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.808204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-6411eea2-43d6-404f-8d46-88627207958f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:48.809847 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1418/2829] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:48 2022] DELETE /identity/v3/projects/7e3e4ed49aac41f68a452f470a338647 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:48.815231 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:48.815514 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:48.815784 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:48.868237 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:48.869479 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:48.938904 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1412/2830] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:48.947158 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:48.947402 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:48.947657 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:48.970625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:48.972264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:48.981442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1419/2831] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:48.986180 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:48.996230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d765-6d3a-42c3-ab30-d1a422fae24f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.004055 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.004749 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.005052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.005432 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.006175 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:49.006487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.008258 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.021050 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1413/2832] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:49.025311 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.035990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efd4df-9869-4334-92b0-aa283d6f6943 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.041203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.041959 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.042223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.042490 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.043182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.045124 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.074252 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1420/2833] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:49.079391 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.091699 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c72e-6a22-4579-96b6-7b6432f5eae7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.159289 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.159979 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.160261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.160537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.161291 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.163257 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.190870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1414/2834] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:49.195198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.208392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef1363-c163-48fb-8d83-18adf95bd9dc admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.213481 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.214154 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.214428 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.214692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.215418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.218826 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.233476 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1421/2835] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:49.239081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.251563 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897dd8e-c9ab-4852-b1db-3d88f86cd440 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.256309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde3502-20fe-4145-9679-35ed991efa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.256972 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde3502-20fe-4145-9679-35ed991efa24 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.257274 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde3502-20fe-4145-9679-35ed991efa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.257537 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde3502-20fe-4145-9679-35ed991efa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.258268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde3502-20fe-4145-9679-35ed991efa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.260210 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde3502-20fe-4145-9679-35ed991efa24 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.271205 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1415/2836] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:49.276908 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.288121 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c0a-a7a3-4d90-b728-15ef677303d7 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.292871 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.293963 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.294236 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.294500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] PATH_INFO: `/v3/projects/345ae2a2ab1044fd9faee298510d294b/users/8ff46d4fb5864c8db506cb944829bfd6/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.311229 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=345ae2a2ab1044fd9faee298510d294b, user_id=8ff46d4fb5864c8db506cb944829bfd6, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.314035 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.331888 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1422/2837] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:49 2022] PUT /identity/v3/projects/345ae2a2ab1044fd9faee298510d294b/users/8ff46d4fb5864c8db506cb944829bfd6/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:49.342489 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.342777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.343115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.371924 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] MFA Rules not processed for user `8ff46d4fb5864c8db506cb944829bfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:49.373250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:49.399288 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:49.445015 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1416/2838] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:49.450610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.541037 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675b6c-adcb-461c-ad5b-61c8bf0e6d3b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.546787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.547667 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.547956 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.548238 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.548951 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.551095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.583645 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1423/2839] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/projects => generated 407 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:49.588169 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.599298 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075a513-8a85-4c2f-9219-8f4582f74791 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.666327 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.667000 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.667284 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.667579 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.668314 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.670362 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.692968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1417/2840] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/users => generated 310 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:49.697407 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.709503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d371d-ad11-4cfc-ae43-1058f9f9985f admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.715196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.715886 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.716179 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.716758 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.717616 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.719552 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.731872 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1424/2841] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:49.736634 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.747241 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416e64-2347-4d80-ac7b-cabf9419ed78 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.752847 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.753809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.754096 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.754368 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] PATH_INFO: `/v3/projects/f3fb629a0f7d4665aa40d090e65f7fca/users/02183199e3fb4a41a9d93079f194cbba/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.775482 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fb629a0f7d4665aa40d090e65f7fca, user_id=02183199e3fb4a41a9d93079f194cbba, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.778281 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.794360 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1418/2842] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:49 2022] PUT /identity/v3/projects/f3fb629a0f7d4665aa40d090e65f7fca/users/02183199e3fb4a41a9d93079f194cbba/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:49.799219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.809554 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cdef5-a6d9-4317-8413-ed503892e021 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.870825 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28553b-9689-48ce-b0b5-85c845b2c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.871513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28553b-9689-48ce-b0b5-85c845b2c49d admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.871787 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28553b-9689-48ce-b0b5-85c845b2c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.872071 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28553b-9689-48ce-b0b5-85c845b2c49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.872831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28553b-9689-48ce-b0b5-85c845b2c49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.874539 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28553b-9689-48ce-b0b5-85c845b2c49d admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.876412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:49.887260 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1425/2843] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:49.892418 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:49.903517 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253a98-89ac-4db6-ba84-13f647d53235 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:49.909448 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:49.910379 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.910666 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.910949 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] PATH_INFO: `/v3/projects/f3fb629a0f7d4665aa40d090e65f7fca/users/02183199e3fb4a41a9d93079f194cbba/roles/07d102a3982549d699bb51ef80e43dd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.913003 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fb629a0f7d4665aa40d090e65f7fca, user_id=02183199e3fb4a41a9d93079f194cbba, role_id=07d102a3982549d699bb51ef80e43dd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:49.915698 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:49.927518 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1419/2844] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:49 2022] PUT /identity/v3/projects/f3fb629a0f7d4665aa40d090e65f7fca/users/02183199e3fb4a41a9d93079f194cbba/roles/07d102a3982549d699bb51ef80e43dd6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:49.999265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.999503 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.999946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:50.028197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] MFA Rules not processed for user `02183199e3fb4a41a9d93079f194cbba`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:50.029706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:50.113445 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1426/2845] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:50.125515 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:50.127767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:50.193891 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497610-40d0-409d-b3d4-9c11df60b88c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:50.197711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:50.198371 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:50.198652 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:50.198919 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:50.209138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:50.210636 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:50.220852 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1420/2846] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:50 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:50.396660 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:50.408293 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65569a-ad7d-4fbc-8e84-5c51a08672bf None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:50.412899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cd74b-44d2-41bc-b379-77c4fd46adbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:50.413604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd74b-44d2-41bc-b379-77c4fd46adbd service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:50.413878 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd74b-44d2-41bc-b379-77c4fd46adbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:50.414137 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd74b-44d2-41bc-b379-77c4fd46adbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:50.483069 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cd74b-44d2-41bc-b379-77c4fd46adbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:50.484923 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cd74b-44d2-41bc-b379-77c4fd46adbd service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:50.494701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1427/2847] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:50 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:55.842261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.863743 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.909569 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43a72e-09d8-46be-938f-394558d44dad service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.914212 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.915114 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.915393 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.915671 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] PATH_INFO: `/v3/users/8ff46d4fb5864c8db506cb944829bfd6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.917265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff46d4fb5864c8db506cb944829bfd6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.918851 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.970363 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff46d4fb5864c8db506cb944829bfd6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:55.982476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff46d4fb5864c8db506cb944829bfd6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:55.983166 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff46d4fb5864c8db506cb944829bfd6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:55.983770 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff46d4fb5864c8db506cb944829bfd6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:55.991070 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff46d4fb5864c8db506cb944829bfd6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.008211 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1421/2848] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:55 2022] DELETE /identity/v3/users/8ff46d4fb5864c8db506cb944829bfd6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:56.013040 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:56.013608 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:56.013716 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:56.032123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:56.033644 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:56.098996 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1428/2849] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:56.108782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:56.110285 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:56.175443 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795def04-7760-4b12-a904-1b1c81479807 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:56.179568 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:56.180247 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:56.180528 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:56.180801 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:56.191181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:56.193007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:56.203669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1422/2850] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:56.503279 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:56.505809 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:56.522989 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317c870-0a9e-452f-9ff2-21f42bd878ba None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:56.528622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:56.529691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:56.530291 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:56.530701 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] PATH_INFO: `/v3/projects/345ae2a2ab1044fd9faee298510d294b` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:56.532574 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=345ae2a2ab1044fd9faee298510d294b)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:56.535164 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:56.563500 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=100 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:56.618171 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345ae2a2ab1044fd9faee298510d294b', 'request_id': 'req-e8d7e10d-5cfe-45f6-b76a-b98e54915984'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.634560 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345ae2a2ab1044fd9faee298510d294b', 'request_id': 'req-e8d7e10d-5cfe-45f6-b76a-b98e54915984'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.640180 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345ae2a2ab1044fd9faee298510d294b', 'request_id': 'req-e8d7e10d-5cfe-45f6-b76a-b98e54915984'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.656204 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] The token cache is being invalidate because project 345ae2a2ab1044fd9faee298510d294b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:56.656489 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.657160 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-e8d7e10d-5cfe-45f6-b76a-b98e54915984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.662196 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1429/2851] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:56 2022] DELETE /identity/v3/projects/345ae2a2ab1044fd9faee298510d294b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:56.663503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:56.673529 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624c16a-e3c5-43f2-9202-a4479b61257a service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:56.718810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:56.738447 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:56.738602 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:56.738790 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:56.739014 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:56.739329 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:56.739605 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:56.739874 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] PATH_INFO: `/v3/users/02183199e3fb4a41a9d93079f194cbba` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:56.741245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02183199e3fb4a41a9d93079f194cbba)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:56.743553 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:56.769794 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:56.771038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:56.792908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02183199e3fb4a41a9d93079f194cbba'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.805476 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02183199e3fb4a41a9d93079f194cbba'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.806163 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02183199e3fb4a41a9d93079f194cbba'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.806782 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02183199e3fb4a41a9d93079f194cbba'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.814045 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02183199e3fb4a41a9d93079f194cbba'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:56.828817 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1423/2852] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:56 2022] DELETE /identity/v3/users/02183199e3fb4a41a9d93079f194cbba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:56.837648 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1430/2853] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:21:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:56.861098 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:56.862614 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:56.935185 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50219cdb-81f7-4e8a-9ed6-d5cd419ce608 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:56.941013 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad06e2-470e-4e34-b880-0c191bea0296 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:56.941732 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad06e2-470e-4e34-b880-0c191bea0296 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:56.942031 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad06e2-470e-4e34-b880-0c191bea0296 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:56.942352 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad06e2-470e-4e34-b880-0c191bea0296 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.013841 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad06e2-470e-4e34-b880-0c191bea0296 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.015429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad06e2-470e-4e34-b880-0c191bea0296 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.024052 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1424/2854] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:21:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:21:57.128588 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.130163 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.149669 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d060-b58c-41b1-96d0-b82a85d5b6b3 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.211543 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.212447 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.212754 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.213033 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] PATH_INFO: `/v3/projects/f3fb629a0f7d4665aa40d090e65f7fca` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.214343 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fb629a0f7d4665aa40d090e65f7fca)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.216258 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.267329 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:57.278622 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fb629a0f7d4665aa40d090e65f7fca', 'request_id': 'req-4d811213-15d7-4312-9026-67e3d1cc309a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:57.284736 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fb629a0f7d4665aa40d090e65f7fca', 'request_id': 'req-4d811213-15d7-4312-9026-67e3d1cc309a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:57.291032 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fb629a0f7d4665aa40d090e65f7fca', 'request_id': 'req-4d811213-15d7-4312-9026-67e3d1cc309a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:57.312913 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] The token cache is being invalidate because project f3fb629a0f7d4665aa40d090e65f7fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:57.313203 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:57.313961 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-4d811213-15d7-4312-9026-67e3d1cc309a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:57.315540 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1431/2855] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:57 2022] DELETE /identity/v3/projects/f3fb629a0f7d4665aa40d090e65f7fca => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:57.320570 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.320853 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.321126 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.328669 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:57.344595 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:57.346110 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.408965 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1425/2856] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:57.416805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.417095 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.417411 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.437862 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:57.439289 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.449011 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1432/2857] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:57.453973 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.464981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9faeae-25f0-4747-b1f1-f76e8f7098ee None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.473700 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.474392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.474667 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.474936 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.475708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:57.476004 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.477681 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.491076 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1426/2858] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:57.495566 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.505564 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ddceb-10f2-4c8f-913d-ac1eeb2e5cd2 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.510766 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc19da-1953-4e41-a589-a9d163a4a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.511439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc19da-1953-4e41-a589-a9d163a4a864 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.511726 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc19da-1953-4e41-a589-a9d163a4a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.512003 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc19da-1953-4e41-a589-a9d163a4a864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.512682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc19da-1953-4e41-a589-a9d163a4a864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.514663 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc19da-1953-4e41-a589-a9d163a4a864 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.548049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1433/2859] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:57.552980 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.563504 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a3fd-c5f8-48ce-b8e2-d2059cb80c8f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.566263 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.566556 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.566834 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.585271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:57.586578 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.621822 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.622615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.623224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.623224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.623834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.625950 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.646724 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1434/2860] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:57.649896 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1427/2861] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:57.654264 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.660029 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.662221 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.667067 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dadb4-2088-4020-8637-8e1bddc6102a None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.682723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.683568 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.683984 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.684245 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.685106 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.687096 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.699392 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1435/2862] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:57.704024 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.716025 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084b97-e17a-4862-860a-62666933c291 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.722682 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.724083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.724655 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.725031 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.725879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.727820 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.744628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1436/2863] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:57.748619 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.756191 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a664d-01eb-4e2a-98e4-472ebc48179b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.762143 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d682f-63c7-45d4-9585-088f5a22ea1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.762846 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d682f-63c7-45d4-9585-088f5a22ea1e service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.762975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9870a1-bd29-4ecc-9351-256c76be1f7b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:57.763172 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d682f-63c7-45d4-9585-088f5a22ea1e service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.763550 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d682f-63c7-45d4-9585-088f5a22ea1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.768125 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:57.768864 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.769265 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.769674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] PATH_INFO: `/v3/projects/b129c20c2c8443a9888e15f3c101246e/users/e7a862ed18974374b75b51437889715e/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.773198 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d682f-63c7-45d4-9585-088f5a22ea1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.775051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d682f-63c7-45d4-9585-088f5a22ea1e service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.785044 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1428/2864] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:21:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:21:57.790570 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b129c20c2c8443a9888e15f3c101246e, user_id=e7a862ed18974374b75b51437889715e, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:57.793405 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:57.817975 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1437/2865] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:57 2022] PUT /identity/v3/projects/b129c20c2c8443a9888e15f3c101246e/users/e7a862ed18974374b75b51437889715e/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:57.822456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec759e0-eba4-46a0-910a-ca1484d597f5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.822746 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec759e0-eba4-46a0-910a-ca1484d597f5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.823093 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec759e0-eba4-46a0-910a-ca1484d597f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.847139 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:57.861567 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2ec759e0-eba4-46a0-910a-ca1484d597f5 None None] MFA Rules not processed for user `e7a862ed18974374b75b51437889715e`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:57.864877 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2ec759e0-eba4-46a0-910a-ca1484d597f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.938203 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1429/2866] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:57.980389 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:57.982362 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.010486 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.010777 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.011230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.031171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.032397 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.045246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139a9f-8ea9-4c6d-a677-e7a97d1005c5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.049501 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.050350 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.050628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.050900 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.059208 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.062892 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.065694 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.075454 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1438/2867] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:57 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:58.092243 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.103959 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1430/2868] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:58.117635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.158270 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c493946-6cad-487a-bbb8-5c381541fefc service cinder] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.163770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.164941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.165678 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.166173 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] PATH_INFO: `/v3/users/e7a862ed18974374b75b51437889715e` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.168472 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a862ed18974374b75b51437889715e)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.172516 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.189115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09aceb-ea2f-47c8-8c6b-70db245071db None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.195043 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb32a3f-61c0-4f50-ae60-f8150efc5e8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.196060 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32a3f-61c0-4f50-ae60-f8150efc5e8c service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.196333 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32a3f-61c0-4f50-ae60-f8150efc5e8c service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.196598 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32a3f-61c0-4f50-ae60-f8150efc5e8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.206962 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb32a3f-61c0-4f50-ae60-f8150efc5e8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.208617 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb32a3f-61c0-4f50-ae60-f8150efc5e8c service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.217715 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1431/2869] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:21:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:21:58.241848 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a862ed18974374b75b51437889715e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.257689 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a862ed18974374b75b51437889715e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.258654 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a862ed18974374b75b51437889715e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.259439 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a862ed18974374b75b51437889715e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.267692 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a862ed18974374b75b51437889715e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.285759 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1439/2870] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:21:58 2022] DELETE /identity/v3/users/e7a862ed18974374b75b51437889715e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:21:58.290566 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4b2a-559e-4492-a5d2-86e34dce0027 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.290867 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4b2a-559e-4492-a5d2-86e34dce0027 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.291133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4b2a-559e-4492-a5d2-86e34dce0027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.311767 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-60eb4b2a-559e-4492-a5d2-86e34dce0027 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.313002 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-60eb4b2a-559e-4492-a5d2-86e34dce0027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.351230 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.386794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1432/2871] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:58.399722 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.401623 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.470891 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f41d39-650d-4274-a315-30b1b221ce57 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.475422 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.476105 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.476450 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.476897 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.488001 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.489590 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.506184 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1440/2872] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:21:58.585615 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.586141 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.586573 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.607468 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] MFA Rules not processed for user `36ab6b3da705454cb7369a68d1dd0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.608696 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.675701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1433/2873] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:58.690239 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.691751 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.715635 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.774273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc1eac-49c3-4d1f-a0db-69a22c682c80 service neutron] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.779628 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e277b-cffe-40ca-8162-262d32a7c647 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c1b7dca4f0464c8f63394d348c95ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.780371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e277b-cffe-40ca-8162-262d32a7c647 service swift] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.780709 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e277b-cffe-40ca-8162-262d32a7c647 service swift] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.781049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e277b-cffe-40ca-8162-262d32a7c647 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.789947 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e277b-cffe-40ca-8162-262d32a7c647 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.791866 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e277b-cffe-40ca-8162-262d32a7c647 service swift] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.801046 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1441/2874] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 20 09:21:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:21:58.821827 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.825469 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.843503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136a9c1-ee07-45ff-85e1-6b5e9c013f01 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.851624 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.852815 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.853162 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.853526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] PATH_INFO: `/v3/projects/b129c20c2c8443a9888e15f3c101246e` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.854882 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b129c20c2c8443a9888e15f3c101246e)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.857752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.919133 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b129c20c2c8443a9888e15f3c101246e', 'request_id': 'req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.926463 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b129c20c2c8443a9888e15f3c101246e', 'request_id': 'req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.936503 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b129c20c2c8443a9888e15f3c101246e', 'request_id': 'req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.954872 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] The token cache is being invalidate because project b129c20c2c8443a9888e15f3c101246e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:21:58.955315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.956268 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c5f6cdf1-f79a-446f-b240-756fe2dc9a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:21:58.958762 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1434/2875] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:21:58 2022] DELETE /identity/v3/projects/b129c20c2c8443a9888e15f3c101246e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:58.963480 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.963767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.964042 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.993596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.995674 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:59.110370 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1442/2876] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:59.118925 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.119202 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.119477 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.149543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:59.151433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:59.161948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1435/2877] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:21:59.166468 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.184586 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e312c2-5155-4ec7-89d7-0bf6dd313ff8 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.189985 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.190693 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.191145 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.191273 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.193391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:59.193391 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.194223 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.211706 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1443/2878] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:59.216635 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.231149 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f160ea8-f0da-494b-a9fb-d4c8ffadf3ff None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.236988 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.237709 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.237981 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.238429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.239412 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.241429 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.276948 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1436/2879] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:59.278009 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.291679 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb80e6-9ef0-4e1f-9cec-cdacbacdc7b3 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.359960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.360805 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.361090 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.361462 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] PATH_INFO: `/v3/users` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.362271 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.364269 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.391606 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1444/2880] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:59.396095 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.406958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed4c52-8265-4b5e-8b2a-42b6174c97fc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.418190 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.418883 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.419161 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.419433 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.420171 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.421885 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.435982 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1437/2881] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:21:59.440427 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.451610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b276-a958-4a84-8560-b7c2ba6d27fc admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.456932 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221f27e-8aee-4ff0-9b18-590fa0536d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.457647 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221f27e-8aee-4ff0-9b18-590fa0536d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.457927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221f27e-8aee-4ff0-9b18-590fa0536d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.458199 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221f27e-8aee-4ff0-9b18-590fa0536d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.459336 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221f27e-8aee-4ff0-9b18-590fa0536d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.461219 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221f27e-8aee-4ff0-9b18-590fa0536d13 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.472718 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1445/2882] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:21:59.477186 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.488051 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db9b1c-9da6-4738-91a3-ef54600aa213 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.493462 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.494389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.494643 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.494908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] PATH_INFO: `/v3/projects/f0b8029066b84132af6999b283070c14/users/2cf960e43c024ffca35a2410c5a428c2/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.515811 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8029066b84132af6999b283070c14, user_id=2cf960e43c024ffca35a2410c5a428c2, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.518870 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.528596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.535081 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1438/2883] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:21:59 2022] PUT /identity/v3/projects/f0b8029066b84132af6999b283070c14/users/2cf960e43c024ffca35a2410c5a428c2/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:59.545938 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.546122 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.546409 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.573569 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.577246 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] MFA Rules not processed for user `2cf960e43c024ffca35a2410c5a428c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:59.579899 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:59.655167 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1446/2884] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:21:59.664083 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.665977 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:59.730184 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21242866-ddad-44e7-b074-beb75fda91c9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.734960 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1df4-074a-4156-b725-e6863a86469c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264ac709e4744acdaf774ab52c165862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.736224 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1df4-074a-4156-b725-e6863a86469c service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.736359 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1df4-074a-4156-b725-e6863a86469c service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.736589 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1df4-074a-4156-b725-e6863a86469c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.746115 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1df4-074a-4156-b725-e6863a86469c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.747616 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1df4-074a-4156-b725-e6863a86469c service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.757483 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1439/2885] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:21:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:22:01.001045 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.003268 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.073139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28db25-b60c-453e-827e-32600adf80a1 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:01.078812 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:01.079869 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.080150 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.080421 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] PATH_INFO: `/v3/users/54a3285266374d66ad871a9d933a05e7` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.081831 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a3285266374d66ad871a9d933a05e7)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:01.083743 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:01.135597 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a3285266374d66ad871a9d933a05e7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.148038 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a3285266374d66ad871a9d933a05e7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.148719 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a3285266374d66ad871a9d933a05e7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.149369 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a3285266374d66ad871a9d933a05e7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.156840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a3285266374d66ad871a9d933a05e7'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.172497 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1447/2886] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:22:00 2022] DELETE /identity/v3/users/54a3285266374d66ad871a9d933a05e7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:01.178170 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.178724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.178724 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.197099 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:01.198331 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.243412 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.245060 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.264315 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1440/2887] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:01.274456 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.276109 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.276762 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:01.330906 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6c10-9436-4fba-acd1-18913fb6ccfc admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:01.335686 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:01.336670 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.336945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.337210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] PATH_INFO: `/v3/users/604e07d31bd14150a9df219195c86b9e` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.339381 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604e07d31bd14150a9df219195c86b9e)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:01.341756 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:01.341989 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24b8b-ba44-492a-903a-f89be2efcad8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:01.346089 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09490013-2416-4565-ad8e-a0e942a324f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:01.346765 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490013-2416-4565-ad8e-a0e942a324f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.347046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490013-2416-4565-ad8e-a0e942a324f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.347324 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490013-2416-4565-ad8e-a0e942a324f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.357380 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09490013-2416-4565-ad8e-a0e942a324f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:01.358968 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09490013-2416-4565-ad8e-a0e942a324f5 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:01.373711 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1441/2888] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:22:01.400561 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604e07d31bd14150a9df219195c86b9e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.415893 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604e07d31bd14150a9df219195c86b9e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.416728 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604e07d31bd14150a9df219195c86b9e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.417723 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604e07d31bd14150a9df219195c86b9e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.428582 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604e07d31bd14150a9df219195c86b9e'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.451471 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1448/2889] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:22:01 2022] DELETE /identity/v3/users/604e07d31bd14150a9df219195c86b9e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:01.455901 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.456319 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.456619 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.475399 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:01.476607 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.529625 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:01.560046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1442/2890] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:01.573153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.575833 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.583632 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.585271 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.603190 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c435e-ee8c-44f0-a94c-82a357e9d0e5 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:01.612383 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:01.614002 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.614596 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.615055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] PATH_INFO: `/v3/projects/83466c2efbd147c0b49a0f47024418a4` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.616927 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83466c2efbd147c0b49a0f47024418a4)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:01.620282 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:01.670758 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f0361-35aa-4efc-b90e-504e97c1d3a9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:01.677702 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:01.678809 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.679294 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.679834 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.698937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:01.701596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:01.717175 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83466c2efbd147c0b49a0f47024418a4', 'request_id': 'req-35225599-6703-4901-a503-402d6f360f6b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.718645 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1443/2891] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:22:01.719475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.722251 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.726948 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83466c2efbd147c0b49a0f47024418a4', 'request_id': 'req-35225599-6703-4901-a503-402d6f360f6b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.741942 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83466c2efbd147c0b49a0f47024418a4', 'request_id': 'req-35225599-6703-4901-a503-402d6f360f6b'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.770426 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] The token cache is being invalidate because project 83466c2efbd147c0b49a0f47024418a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:22:01.772140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.774532 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:01.778513 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1449/2892] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:22:01 2022] DELETE /identity/v3/projects/83466c2efbd147c0b49a0f47024418a4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:01.900232 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa00a-3c85-4d48-a2d7-93eff5cef9e0 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.039138 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.040181 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.040565 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.041116 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.043490 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:02.058793 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.060526 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.068584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.075134 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1444/2893] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:22:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:22:02.121410 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.123030 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:02.169424 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.218055 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225599-6703-4901-a503-402d6f360f6b admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.224821 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.226182 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.226676 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.227198 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] PATH_INFO: `/v3/projects/d51a1740c0874a7f9d17e6bfea5f728c` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.228822 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51a1740c0874a7f9d17e6bfea5f728c)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.231442 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.286478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51a1740c0874a7f9d17e6bfea5f728c', 'request_id': 'req-058df29b-0c62-44e2-9297-893e7291760a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:02.292688 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51a1740c0874a7f9d17e6bfea5f728c', 'request_id': 'req-058df29b-0c62-44e2-9297-893e7291760a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:02.299941 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51a1740c0874a7f9d17e6bfea5f728c', 'request_id': 'req-058df29b-0c62-44e2-9297-893e7291760a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:02.315210 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] The token cache is being invalidate because project d51a1740c0874a7f9d17e6bfea5f728c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:22:02.315502 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:02.316139 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-058df29b-0c62-44e2-9297-893e7291760a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:02.317782 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1450/2894] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:22:02 2022] DELETE /identity/v3/projects/d51a1740c0874a7f9d17e6bfea5f728c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:03.252261 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:03.253990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:03.270788 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74594a4-cffc-45e7-b812-96f12adc001f service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:03.335370 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:03.336250 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:03.336906 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:03.337168 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] PATH_INFO: `/v3/users/2cf960e43c024ffca35a2410c5a428c2` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:03.338460 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf960e43c024ffca35a2410c5a428c2)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:03.340369 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:03.397398 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf960e43c024ffca35a2410c5a428c2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:03.410499 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf960e43c024ffca35a2410c5a428c2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:03.411309 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf960e43c024ffca35a2410c5a428c2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:03.411939 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf960e43c024ffca35a2410c5a428c2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:03.419173 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf960e43c024ffca35a2410c5a428c2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:03.434358 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1445/2895] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:22:03 2022] DELETE /identity/v3/users/2cf960e43c024ffca35a2410c5a428c2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:03.439157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:03.439633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:03.439840 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:03.458638 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:03.459870 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:03.527583 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1451/2896] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:03.538990 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:03.541507 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:03.604464 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47056-6675-4319-a643-67e9acd1ecd2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:03.609032 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faceff-47e5-4b66-b07b-0138a8188545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:03.609738 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faceff-47e5-4b66-b07b-0138a8188545 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:03.610019 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faceff-47e5-4b66-b07b-0138a8188545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:03.610292 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faceff-47e5-4b66-b07b-0138a8188545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:03.621100 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faceff-47e5-4b66-b07b-0138a8188545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:03.622586 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faceff-47e5-4b66-b07b-0138a8188545 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:03.632701 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1446/2897] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:22:03.930408 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:03.931879 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:03.944318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc75b-26bd-4803-b882-6fd64d14123f None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:03.949157 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:03.950403 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:03.950677 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:03.950945 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] PATH_INFO: `/v3/projects/f0b8029066b84132af6999b283070c14` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:03.952140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b8029066b84132af6999b283070c14)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:03.954088 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.004140 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b8029066b84132af6999b283070c14', 'request_id': 'req-d378a0e4-ebba-4b51-9b43-33b5e622732a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:04.005301 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:04.011112 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b8029066b84132af6999b283070c14', 'request_id': 'req-d378a0e4-ebba-4b51-9b43-33b5e622732a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:04.018020 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b8029066b84132af6999b283070c14', 'request_id': 'req-d378a0e4-ebba-4b51-9b43-33b5e622732a'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:04.032640 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] The token cache is being invalidate because project f0b8029066b84132af6999b283070c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:22:04.032918 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:04.033680 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-d378a0e4-ebba-4b51-9b43-33b5e622732a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:04.035250 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1452/2898] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:22:03 2022] DELETE /identity/v3/projects/f0b8029066b84132af6999b283070c14 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:04.040487 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.040790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.041064 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.062200 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:04.063407 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:04.083543 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:04.129966 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1447/2899] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:04.139083 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.139371 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.139650 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.159770 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:04.160990 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:04.174520 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1453/2900] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:04.179108 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.189065 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f328c4e-9e71-433d-87f9-bdb9f7a96d99 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.196596 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.197336 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.197580 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.197873 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.198810 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:04.199164 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.202007 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.215461 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1448/2901] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Jul 20 09:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:04.219999 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.230549 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b55d1-5a86-405a-aa72-ef70261b3079 None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.236117 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.236767 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.237036 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.237354 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.238047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.239960 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.272795 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1454/2902] 10.222.0.67 () {60 vars in 1152 bytes} [Wed Jul 20 09:22:04 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:04.279871 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.292046 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fd51-bb95-4338-b670-00e9569540e7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.355574 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.356245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.356520 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.356773 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.357475 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.359389 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.383223 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1449/2903] 10.222.0.67 () {60 vars in 1143 bytes} [Wed Jul 20 09:22:04 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:04.387610 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.398505 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578747-ea62-4bf1-bef7-b1d5a950bd73 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.404099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.404761 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.405028 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.405333 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.406049 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.407789 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.418593 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1455/2904] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:22:04.422794 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.433478 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce705f-0698-43f9-87b7-6fa31475b03d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.438708 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363e57f-17b9-43a8-88bf-c65e011a45b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.439535 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363e57f-17b9-43a8-88bf-c65e011a45b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.439806 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363e57f-17b9-43a8-88bf-c65e011a45b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.440087 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363e57f-17b9-43a8-88bf-c65e011a45b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.440807 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363e57f-17b9-43a8-88bf-c65e011a45b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.442453 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363e57f-17b9-43a8-88bf-c65e011a45b7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.453920 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1450/2905] 10.222.0.67 () {58 vars in 1121 bytes} [Wed Jul 20 09:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:22:04.459099 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.472633 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465d927-9ede-49b5-bfd7-55fbc31540ee admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.478153 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.479317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.479317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.479618 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] PATH_INFO: `/v3/projects/6b60e48fc9844b719201661a946a647e/users/81d7d039482940a6b6bf52dac63dcd96/roles/550e64942da9455c93c07ee3fa124eb6` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.496573 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b60e48fc9844b719201661a946a647e, user_id=81d7d039482940a6b6bf52dac63dcd96, role_id=550e64942da9455c93c07ee3fa124eb6)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.499318 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.515317 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1456/2906] 10.222.0.67 () {60 vars in 1482 bytes} [Wed Jul 20 09:22:04 2022] PUT /identity/v3/projects/6b60e48fc9844b719201661a946a647e/users/81d7d039482940a6b6bf52dac63dcd96/roles/550e64942da9455c93c07ee3fa124eb6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:04.526678 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.526963 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.527240 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.561069 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] MFA Rules not processed for user `81d7d039482940a6b6bf52dac63dcd96`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:04.562353 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:04.634502 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1451/2907] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:04.646601 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:04.648478 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:04.711413 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0d0d4-e87b-4df4-8395-e443ee47a984 admin admin] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:04.715649 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5cb9b-56ff-4619-8e1b-e51e5b7a23a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d3b8154d784b779c87717947789ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:04.716342 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5cb9b-56ff-4619-8e1b-e51e5b7a23a7 service glance] REQUEST_METHOD: `GET` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:04.716625 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5cb9b-56ff-4619-8e1b-e51e5b7a23a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:04.716894 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5cb9b-56ff-4619-8e1b-e51e5b7a23a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:04.727206 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5cb9b-56ff-4619-8e1b-e51e5b7a23a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:04.728691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5cb9b-56ff-4619-8e1b-e51e5b7a23a7 service glance] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:04.739172 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1457/2908] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:22:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:22:14.631392 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:14.734266 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=3 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:27.836077 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.904059 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa524c-01ee-4e8b-a9f3-987eb7c2bf67 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:27.909283 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:27.910179 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.910459 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.910735 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] PATH_INFO: `/v3/users/81d7d039482940a6b6bf52dac63dcd96` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.911937 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d7d039482940a6b6bf52dac63dcd96)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:27.913944 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:27.969074 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d7d039482940a6b6bf52dac63dcd96'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:27.983712 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d7d039482940a6b6bf52dac63dcd96'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:27.984414 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d7d039482940a6b6bf52dac63dcd96'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:27.985026 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d7d039482940a6b6bf52dac63dcd96'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:27.992547 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d7d039482940a6b6bf52dac63dcd96'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:28.005880 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1452/2909] 10.222.0.67 () {58 vars in 1223 bytes} [Wed Jul 20 09:22:27 2022] DELETE /identity/v3/users/81d7d039482940a6b6bf52dac63dcd96 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:28.010691 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] REQUEST_METHOD: `POST` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.011197 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.011314 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.030242 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.auth.core [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] MFA Rules not processed for user `dd5ea26c982443d3be385f2d15148248`. Rule list: `[]` (Enabled: `True`). {{(pid=80405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:28.031446 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:28.093047 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1458/2910] 10.222.0.67 () {58 vars in 957 bytes} [Wed Jul 20 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:22:28.103062 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.104584 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:28.196796 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa657-2769-4c98-898c-6d90e243271f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.201727 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31629ab2ee4a43a290db0875f619fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.202387 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.202661 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.202931 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.216752 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:28.218265 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:28.228259 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1453/2911] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:22:28.526978 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] Authenticating user token {{(pid=80405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.528604 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.fernet_utils [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:28.541946 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3a5b5-822c-4d5b-a258-e84c5b82d3fa None None] Validating token access rules against request {{(pid=80405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.547241 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd5ea26c982443d3be385f2d15148248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dd52d259a841e396b3c70a528da3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.548194 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.548544 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.549418 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] PATH_INFO: `/v3/projects/6b60e48fc9844b719201661a946a647e` {{(pid=80405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.550212 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b60e48fc9844b719201661a946a647e)` {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:28.552123 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] RBAC: Authorization granted {{(pid=80405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:28.609704 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b60e48fc9844b719201661a946a647e', 'request_id': 'req-81b5009a-14bf-4afa-9e51-81890360aa86'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:28.615374 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b60e48fc9844b719201661a946a647e', 'request_id': 'req-81b5009a-14bf-4afa-9e51-81890360aa86'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:28.621755 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b60e48fc9844b719201661a946a647e', 'request_id': 'req-81b5009a-14bf-4afa-9e51-81890360aa86'} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:28.637116 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] The token cache is being invalidate because project 6b60e48fc9844b719201661a946a647e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:22:28.637364 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:28.638155 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG keystone.notifications [None req-81b5009a-14bf-4afa-9e51-81890360aa86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:22:28.639885 dv-cinder-843309-5-smb devstack@keystone.service[80405]: [pid: 80405|app: 0|req: 1459/2912] 10.222.0.67 () {58 vars in 1232 bytes} [Wed Jul 20 09:22:28 2022] DELETE /identity/v3/projects/6b60e48fc9844b719201661a946a647e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:38.223790 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:38.633859 dv-cinder-843309-5-smb devstack@keystone.service[80405]: DEBUG dbcounter [-] [80405] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:06.592340 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:06.594039 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:06.669768 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311605e-4269-45c4-81c8-274a1e0e222a service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:06.732986 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b3524ba3d94d45ad789b39e0380b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '974a10cf529746abaaf5b8430cc01156', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:06.733707 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:06.733958 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:06.734245 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:06.736135 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:06.747812 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:06.749439 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c029864-2965-480e-9da0-a2dbc8a34d9f service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:06.759908 dv-cinder-843309-5-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1454/2913] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:27:16.755928 dv-cinder-843309-5-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=58 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}